I have a lot of Danish adresses. Each consists of a street name, street number, the zip code, the wgs84 latitude, the wgs84 longitude, and the two etrs89 geografical codes. For each address I want to find the municipality it belonged to before the municipality reform in Denmark in 2007. I have a MapInfo file of the borders of the old municipalities. They are available for download at
http://dendigitalebyport.byhistorie.dk/kommuner/kort/1983-2007.zip
and the municipalities that I am interested in are the kommuner1983 files.
My adresses are in a tab delimited .txt file. As a small example consider the following to adresses as my dataset:
Street_Name Street_Number Zip_code wgs84_latitude wgs84_longitude etrs89_E etrs89_N
Fiskerhusene 48 2620 55.6709437309216 12.3582957724047 711181.68 6174570.88
Astershaven 31 3210 56.0868923892299 12.1496032848558 695955.68 6220222.08
I have been told that I can do this with either MapInfo or QGIS. I have downloaded both, and I am able to open the Kommuner1983.TAB file and get a map of Denmark, but I can't open the .txt file. Can Anyone help me on how to merge the two datasets?
As I am totally new to GIS data, MapInfo, and QGIS, it's posibble that I lack data in order to do what I want to do. If this is the case, please let me know what I am missing.
Thanks a lot!
You can create a mysql table and store the lat lng pairs in a point datatype. Then you can create a spatial index on this column and use the borders to find the lat lng pairs.
Related
Basically, I'm using SPSS and have a variable named AREA that includes different major counties in California. Within this variable there is a value label for "Other" and I want to be able to relabel the data to go in their respective county. I have an excel sheet with all the zip codes that fall into those "Other" counties and do have a zip code data in the file as well. There are 400+ zip codes so I'm trying to see if there is an easy alternative to having to manually type in each zipcode into syntax to recode those values.
I've tried seeing if there was a way to reference the excel workbook, but have come up empty handed.
Any guidance or approaches to this problem would be appreciated!
The data in excel has unique zipcodes with corresponding Area value in cell to the right. In the data set there may be multiple instances of each zipcode.
I'm making a map use echarts with geojson mapdata,but i need a geojson resource that contain main cities of all of country of the world,i had looked for everywhere on website ,but the mostly resource is just have border of country not has cities border data. and i also checked the highcharts mapdata resource but the crs option is ESPG type .i need the Longitude latitude coordinates
depends on how many city do you want?
If you want 36430 city with only city name, go here
https://github.com/drei01/geojson-world-cities
If you want 1240 city with lots of details info go here: (choose populated-place)
http://geojson.xyz
if you only need major 120 city with only city name go here: (choose world city)
https://github.com/mapbox/mapping
Go to http://geojson.xyz and look for "populated places" and "populated places simple"
You can also take GeoJSON from website NaturalEarhData.com available at Github e.g ne_10m_populated_places.geojson and ne_10m_populated_places_simple.geojson
In fact, GeoJSON.xyz takes the data from NaturalEarthData.
Here you have geojson of continents, countries, country groupings, regions and states of all the world:
https://github.com/rapomon/geojson-places
I have a list of strings (noun phrases) and I want to filter out all valid geographical locations from them. Most of these (unwanted location names) are country or city or state names. What would be a way to do this? Is there any open-source lookup table available which contains all country, states, cities of the world?
Example desired output:
TREC4: false, Vienna: true, Ministry: false, IBM: false, Montreal: true, Singapore: true
Unlike this post: Verify user input location string is a valid geographic location?
I have a high number of strings like these (~0.7 million) so google geolocation API is probably not an option for me.
You can use geoplanet data by Yahoo, or geonames data by geonames.org.
Here is a link to geoplanet TSV file containing 5 million geographical places of the world :
https://developer.yahoo.com/geo/geoplanet/data/
Moreover, geoplanet data will provide you type ( city,country,suburb etc) of the geographical place, along with a unique id.
https://developer.yahoo.com/geo/geoplanet/guide/concepts.html
You can do a lowercase, sanitized ( e.g. remove special characters and other anomalies) match of your needle string to the names present in this data.
If you do not want full file scans, first processing this data to store it in a fast lookup database like mongodb or redis will be beneficial.
I can suggest the following three options:
a) Using the Alchemy API: http://www.alchemyapi.com/
If you try their demo, places like France, Honolulu give the entity type as Country or City
b) Using TAGME: http://tagme.di.unipi.it/
TAGME connects every entity in a given text to the corresponding wikipedia page. Crawl the wikipedia page and check the infobox and filter
c) Using Wikipedia Miner: I was unable to find relevant links for this. However, this also works like TAGME.
Suggest you to try all three and do majority voting for each instance.
Looking for a way to get a list of telephone area codes for a given latitude and longitude (and if necessary a given intl. code.) Note, I'm not talking about international dialing prefixes but the area codes within them.
For example, Denver Colorado is covered by the area codes 303 and 720. It's at 39.739 -104.985 and is in NANP 1. So given 39.739,-104.985,1 I'd like to get back [303,720].
Libraries, web services, DB's, or raw data that needs to be parsed into a DB, e.g., a web page of shape points, are all fine and the more global coverage the better, but just NANP 1 would be a great help.
Note I already use MaxMind and could turn the lat-lng into a fake IP and use that as the lookup key, but MaxMind claims only U.S. area codes (whether they truly mean U.S. or actually NANP I haven't tested) and seemingly only 1 per location (e.g. just 303 for Denver.) So it's a possibility, just not a great one.
UPDATE: I found some more relevant information, but no definitive solutions so I'm listing it here rather than in an answer:
I was able to find two U.S. databases http://www.area-codes.com/area-code-database.asp and http://www.nationalnanpa.com/area_codes/index.html (50% down the page, MS Access file.) The former includes lat/lng for $450 and the latter would require nearest-neighbor matching as KeithS talks about (it's probably the same DB underlying the NANPA City Query he found.)
Additionally I found information that implies Teleatlas has area code boundary maps and that ESRI includes area code shape files with copies of ArcGIS. Maponics seems to have data available: there's a Google Maps implementation of Maponics' data at http://www.usnaviguide.com/areacode.htm.
Wow. You'll definitely need some sort of pre-existing database of points. My first thought was ZIPList5 Geocode. It includes lat-long data for each active U.S. ZIP code, so you can throw this data in a DB table, index the hell out of it, and search by just about any geographic info you'd have access to. You can buy one copy for $40, with enterprise-level use for $100. Only problem is that this DB has only the "primary" area code for each ZIP code, so metro areas that have more than one (Dallas, Chicago, NYC) aren't going to show all of them.
You could try a two-pronged approach with some free data I found: for a given latitude and longitude, do a nearest-neighbors search of the data in the USGS Geographic Names Information System; it includes information on every human habitation center, and every named landmark feature, with lat/long coordinates of their centers. You now have your lat/long point mapped to the nearest town/city, ZIP code, county, and state. Now, you can compare that against this list of U.S. Area Codes, to find area codes matching any or all of the identifying information from the USGS. This is all free, and will eventually get you what you need, but you'll probably have to do some work to "massage" the two sets of data into something you can efficiently cross-reference, and/or you'll need to implement a good "search engine" that will accurately find nearest-neighbor named points, and then find area codes for locations matching the names.
One more thing to look at is NANPA, which administers area code assignment to begin with. I'm sure they have a more comprehensive downloadable DB, but the only free public access I could find was this search page, which will find area codes for any city with >20k people. You could turn your lat/long data into a city and state, and then hit this search page: NANPA City Query
Here is an option:
http://geocoder.ca/39.739,-104.985?geoit=xml
<TimeZone>America/Denver</TimeZone>
<AreaCode>720,303</AreaCode
I used MindData's free database for blocks and location data, and then found a free table for full country names (all 249 countries, excluding the 5 disputed ones). My issue is that I'd like to find a table of all the full region names. For example, in the GeoIP location table, the region called MD would be Maryland, but there's no lookup for that particular state. Where can this be found?
Thanks all,
-Steve
The MaxMind documentation for the GeoIP database includes that exact question in their FAQ: Where can I get a conversion table of region codes to names?
(They provide their own look-up tables, both for the US and Canada and for other countries.)