OruxMaps

Thanks for these LiDAR DTM  :D



France could be available one day... ? I'm already happy with Pireneos today  :D

Switzerland and France are available now too:



//http://data.opendataportal.at/dataset/dtm-france

//http://data.opendataportal.at/dataset/dtm-switzerland

It's not to criticize, since I'm using the same datasets, but France is not that precise. I mean, data in itself is (usually but not always) good but we are talking about a 75m grid in Lambert projection that needs quite a bit of interpolation to be used in OM. Also the Nice Cote d'Azur dataset while formally 5m is actually uspsized from a much lower resolution. Still, it was nice for a moment to believe that the IGN had released their BDALTI5 as OpenData... :-)

Hi Maki,



You're right, due to the lack of more detailled opendata DTMs of France I had to use the most detailled data which is available for free in a specific region. For most parts of France that's the IGN 75 m model. But especially the Alps and the Pyrenees are better in details, cause I was able to use finer source data there.



The interpolation and downsampling of the 75m-DTM hardly influences the final results . Since all of my datasets have a minimal resolution of 20m or 1" of course I had to upsample the 5m- Cote-d'Azur grid. Who's interested in more detailed source data could download the original 5m- DTM of Cote-d'Azur.

1"-DTMs are more than enogh in detail level for Hiking maps, even in high alpine countries like Austria, Switzerland or the French and Italian alps.



So all in all, I would be glad myself if IGN France would provide better sourcedata for free, ideal would be 20m or finer Lidar data. But in the moment I'm sure you'll find no better 1"-Opendata Models of France than those offered here.  ;)

There is a misunderstanding. When I say that  the Nice Cote d'Azur data is upsampled I'm not referring to your dataset but to the original one. Just render it as hillshading in QGIS and look at it wit 100% magnification: you'll see severe pixelation, which means the actual data has a coarser resolution, even if stored as a 5 meters grid original data is probably 20-25 meters or so. When resampled and reprojected to DEM standards it's very good of course.

The rest of France is 75 meters which means that a summit may appear several tens of meters off its real position. It is not a problem for OruxMaps use, but if you create contour lines from it it's far from ideal. Also using it for slope calculations could lead to fake results.

But, as you say, it's the best we have. It's a pity that IGN France still hasn't embraced Open Data because they have very good datasets.

Ah ok, now I understand you. The difference of nominal resolution versus the objective resolution af a DTM. You're absolutely right!



A good example are the widespread SRTM datafiles. Its nominal resolutions are 1" worldwide nowadays. If you compare their level of details especially regarding narrow gorges or rocky mountain areas to those of 1"-files based on LIDAR data: The optical difference and improvement of richness of details is BY FAR better in the LIDAR-based DTM - although both models have the same nominal resolution of 1".



Regarding Cote-d'Azur and also all other source data I used in France you're right.



But the important question for me was: "Is the source-data an improvemnet in richness of details compared to the common used SRTM-files (or those of viewfinderpanoramas.org) ?".

And this question is true for Cote-d'Azur although its real resolution is not 5 meters for sure but somewhat coarse-meshed data. And this is also the reason why I published the DTMs of France at all: The 75m IGN-grid is far from optimum. But they are still a slight improvement in quality compared to the SRTM-files. I checked that before I started creating the French DTMs.

I spent many hours and weeks to collect and edit the source data for creating a DTM for the whole country of Italy.

Most of the Italian regions provide more or less high quality data. For those who don't, I used 1" SRTM data. Now the project is finished and available here:



//http://data.opendataportal.at/dataset/dtm-italy

There's been a problem in the Northwest of the Italian files. Please download the corrected ones here:

//http://data.opendataportal.at/dataset/dtm-italy

Dear Oruxmaps-Friends,



I've spent lots of hours during the last months to collect, check and resample data. Just before Christmas I'm going to give you the result – several new DTMs – as a present:



Belgium:

//http://data.opendataportal.at/dataset/dtm-belgium



Denmark:

//http://data.opendataportal.at/dataset/dtm-denmark



Estonia:

//http://data.opendataportal.at/dataset/dtm-estonia



Finland:

//http://data.opendataportal.at/dataset/dtm-finland



Lavia:

//http://data.opendataportal.at/dataset/dtm-latvia



Netherlands:

//http://data.opendataportal.at/dataset/dtm-netherlands



Norway:

//http://data.opendataportal.at/dataset/dtm-norway



Sweden:

//http://data.opendataportal.at/dataset/dtm-sweden



Enjoy them within new maps, Sonny.

As far as I know, I've now completed the list of European countries where Opendata LIDAR source data is available. If you notice that there are new European countries providing high quality Opendata DTMs in the future, feel free to contact me!



Finally something regarding myself: During the last 2.5 years I spent many, many Hundreds of hours during my leisure time to search for new Opendata source files. I've written hundreds of Mails – mostly in foreign languages ;-) – to contact public authority of the individual countries to help me with finding free and often hidden source data of their country. I had to download giant amounts of source data. I had to search for errors, plug holes within the data, compile, resample it and create files in useful formats. To provide them to you, the community for free.



It would make me very happy, if you honor this work by supporting me with a Donation. I've created a DONATIONLINK via PAYPAL:

//https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=E6GG3NPU88ZQE&source=url



THANK YOU VERY MUCH, Sonny.

I have created new files of Germany-Saxony, which you can download here:

//https://data.opendataportal.at/dataset/dtm-germany

After lots of hours of work, finally the latest version of DTMs of Spain are ready for Download:

https://data.opendataportal.at/dataset/dtm-spain (https://data.opendataportal.at/dataset/dtm-spain)

I therefor used the latest available source-files of the Spanish survey Institute. Most improvements are in regions which lack of LIDAR source data in the previous DTMs: Andalusia and the Balearic Islands.
Now the whole territory of Spain is covered by high quality LIDAR data.

There's a new DTM, of Northern Ireland which you can download here:

https://data.opendataportal.at/dataset/dtm-united_kingdom (https://data.opendataportal.at/dataset/dtm-united_kingdom)

Good news: After lots of hours research, contact with different institutes across the country, quality checks etc. there's for the first time a high-quality DTM of the whole United Kingdom

https://data.opendataportal.at/dataset/dtm-united_kingdom (https://data.opendataportal.at/dataset/dtm-united_kingdom)

For about 75% of England, Wales, Northern Ireland fine LIDAR source data available, Scotland
unfortunately (beside river valleys and coasts) is not covered as well. For the areas not covered with fine LIDAR-data I used OS DTM-50m which is wider gridded but also based on LIDAR source data and hence especially in wooden areas more accurate than SRTM data.

Enjoy the new DTMs of the UK!

Hey Sonny, I am looking for N52E10 in your DTM's 1" but it seems to be missing in Europe and Germany aswell!?

Since some weeks LiDAR source data of the whole territory of France in its finest resolution is available as OpenData. So during the last weeks I created enhanced DTMs of France:
https://data.opendataportal.at/dataset/dtm-france (https://data.opendataportal.at/dataset/dtm-france)

Additionally Wallonia (Souther Belgium) also provides their LiDAR sources in its finest resolution as OpenData. So I created enhanced DTMs for Belgium too, now the whole country is complete in highest resolution:
https://data.opendataportal.at/dataset/dtm-belgium (https://data.opendataportal.at/dataset/dtm-belgium)

Have fun, Sonny.

Hi Sonny,

thanks a lot for these files.
Just one point : this delivery for France (1") do NOT include N50E000.hgt that was present in previous deliveries, and is supposed to be present according to Gebiet(Area).png

Since this zone is almost 100% above sea (and very very little above ground), maybe it is volunteer to have removed this file, but I prefered to be sure you are aware of it, in case it's a bug.

Regards
Laurent

You're right, this file is not included any more with France because it's just sea and land area of UK. I just updated the Gebiet (Area).png Screenshot

I created a new DTM of Iceland:

https://data.opendataportal.at/dataset/dtm-iceland

Have fun!

Thank you once more !

Note for Jose now : it would be great to have an option allowing to download these files directly from within OruxMaps, rather than the current 3" files that OM downloads

I created a new Version of Swiss DTMs, with great improvements in large parts of the country:
https://data.opendataportal.at/dataset/dtm-switzerland

They are based on new high-quality OpenData sources of Swisstopo.

By the way: I created a Twitter account to post news and answer questions. If you want me to follow:
https://twitter.com/SonnyLidarDTMs (https://twitter.com/SonnyLidarDTMs)

I created new DTM of the whole of Germany. Not each federal state is offering OpenData elevation data yet. Please open the image "_Sources.png" in the download package to check the type of Sourcedata for each region.
https://data.opendataportal.at/dataset/dtm-germany (https://data.opendataportal.at/dataset/dtm-germany)


Furthermore I created a new DTM of Slovakia, please check:
https://data.opendataportal.at/dataset/dtm-slovakia (https://data.opendataportal.at/dataset/dtm-slovakia)

I have been using the excellent 1" DTMs by Sonny for quite some time with OruxMaps.

Now, after downloading the new high resolution 0.5" DTM for Austria [DTM Austria 0.5" v2 by Sonny], I realized that OruxMaps does not indicate elevation on the dashboard [Elevation (DTM)/Höhe (DTM) shows "--- m"] for these 0.5" .hgt-tiles, while elevation for neighboring 1" hgt-tiles is correctly displayed.
Likewise, creating a track by hand yields waypoints with elevation 0.

The underlying data, however is correctly displayed in Terrain Shading/Geländeschattierung of maps.
Also, when creating a route with brouter, brouter utilizes altitude information from the 0.5" DEM correctly.

Can orux please comment on this - maybe OruxMaps (I am currently using OruxMaps v.8.1.10 GP) needs an update for this display problem.

Hi @sonny!
Simple question about 1" DTM for France : did you use RGE alti https://geoservices.ign.fr/rgealti ?
If yes, could it be possible to generate 0.5" DTM with RGE ALTI 1 m dataset ?
Thx in advance for your answer :)

Hello,
with OruxMaps v.9.0.4 GP I can no longer use the terrain shading function (here the LiDAR DEM files are used) without constant crashes.

The map is no longer (completely) loaded when zooming. I had to disable the feature.
Probably the calculation takes too many resources

mobile phone:
G930F Galaxy S7 (SM-G930F)

@Matthias,
which hillshading function have you activated, when your OruxMaps crashes?

settings-> Maps -> Apply hill shadows
or
settings-> Maps -> Mapsforge settings->Apply hill shadows

try the other method then.
Matt

Hi,

I have the same problem in OruxMaps v.9.0.4 GP as well as in latest Beta8 on a Galaxy S9. The app doesn't crash but I see a black stripe. I use the DEM Data from within OruxMaps, which you can download by using "Further instruments => download height model data". I'm sure that I downloaded height data for the whole map area. The problem occurs for example with the openandromaps overview maps (which are not of mapsforge type) and the openandromaps italy card (which ist mapsforge).

The black stripe occurs when "settings-> Maps -> Apply hill shadows" is activated on its own (meaning "settings-> Maps -> Mapsforge settings->Apply hill shadows" is off). With all other settings the black stripes are gone.   Using both activated settings is not a good solution, because the hill shading result doesn't look very good.  The setting "settings-> Maps -> Apply hill shadows" alone seem to give the best result for mapsforge maps but -as explained- comes with "black stripes".

Example pictures are attached. The "black stripe problem" didn't occur in earlier versions of OruxMaps, at least in my case.

P.S. unfortunaltely sonnys lidar DTM data seems not to be accessible at the moment...

@tstreibl,
regarding ypur "P.S.":

Sonny mentioned at twitter, that his LiDAR-DTMs can be temporarily accessed via https://sonny.4lima.de/ , until the original location is back.
Matt

@Matt: thanks a lot! Certainly to Sonny, too.

first of all, i will say that i am a rookie user.

There are 6 years from the first post at this topic. As we can see, the europe coverage is not finished. The next issue is the rest of the world map. Because mountains ... there are all over the planet earth.
- As a european citizen, i also know very well that the ESA organizacion collects every year hundreds of millions of euros to keep working flawless. They have one alive project to "scan" the planet earth ... continuously.

why are we stuck here? There is no data to calculate new countries or the computers are very slow ?

Hi,

I tried out Sonny's 1'' DTM, but things got worse. In some parts of the map hill shading doesn't take place at all. So I can even get a mixture of black boxes, shaded and unshaded regions (see attached screenshot). For the result it doesn't matter if the DTM data is stored on internel or external sd card.

@Ineam:  I guess at first place it's a new rendering problem in the app, which didn't occur in earlier versions. I don't think that .hgt tiles are missing in the black box areas. Maybe my phone is too slow.

Hi,

all my problems are resolved all of a sudden: My S9 received a software update and at the same time I installed new beta 1 (at the meantime beta 3) from 9.4.xx betas. Since then no more black stripes. Sonny's 1'' DTM, as well as the DEM Data from within OruxMaps work like a charm. Same with OruxMaps v.9.0.4 GP from store.

Sorry for the fuss, Tilo

Hi,
Apologies for my partially, if not totally, unrelated question.
Since ~70% or our earth is covered by water, mainly ocean, i was wondering if some DEM data is available which models the ground "under sea level"?

EDIT: question came up at a bar. I was showing a friend OruxMaps with OpenAndroMaps, DEM/LiDAR files, BRouter,...
The friend is not only a biker, but also a diver and sailor ;-)

Matt

Hi Matt.
Although they are difficult to find, there are indeed bathymetry DEM files that model marine topography DEM .hgt files generally have land cover, and for areas covered by oceans or seas they show values ​​equal to 0.
GEBCO offers bathymetry in georiff format that can be converted to .hgt. They don't have a high resolution but they are useful.
https://download.gebco.net/
I don't know if I'm right but I think NASA also offers bathymetry files in various formats. Additionally, Google has a height correction service that has marine coverage.  you can draw a track or route in OruxMaps and use the Google URL to return the bathymetry along the track or route created over marine areas.

Felipe

I created new DTMs of Germany and Luxembourg

Download: https://sonny.4lima.de (https://sonny.4lima.de/)

For Germany I used new LiDAR source data of Hessen and Bayern. And the quality of Baden-Württemberg, Saarland, Niedersachsen, Bremen, Schleswig-Holstein, Mecklenburg-Vorpommern got significantly improved, especially in wooden areas.
For Luxembourg I used finer LiDAR source data.

Have a good time!   

High accuracy DEM files are increasingly becoming available. Some are based on 2m, 5m or 10m grids, compared to 30m for the SRTM DEM data. An overlay file of 2m or 5m interval contours can be made for Oruxmaps, from multiple .asc ASCII DEM files, with a Windows PC. .prj files are also required to provide the projection data. Oruxmaps will show these contours as an overlay on other maps eg OSM or OpenAndroMaps.

Gdal can be used to make a kml file from the .asc and .prj files. A full install of Gdal on Windows is complcated. However only 2 Gdal programs are needed here, and they can be obtained by installing only the core gdal programs from the file:
'gdal-3.6.2-1930-x64-core.msi' (34MB) from 'https://www.gisinternals.com/query.html?content=filelist&file=release-1930-x64-gdal-3-6-2-mapserver-8-0-0.zip'
This allows execution of non-Python gdal programs, including gdalbuildvrt and gdal_contour.

Download the required .asc and .prj DEM files and place them in a folder eg C:\Maps\Temp. Tip: If the files are in different folders, use File Explorer search *.asc and *.prj then copy-paste or cut-paste these files into C:\Maps\Temp. Selecting large areas to download will result in very large files and slow operation.

1. Open a cmd.exe window and type: chdir "C:\Program Files\GDAL". Check the gdal installation is ok by typing 'gdalinfo --version'.

2. Make a gdal .vrt file of all the .asc file names: type
gdalbuildvrt "C:\Maps\Temp\All_ASC_Files.vrt" "C:\Maps\Temp\*.asc"

3. Make a KML contour file, eg with 5m interval: type
gdal_contour -a elev -i 5 -f KML "C:\Maps\Temp\All_ASC_Files.vrt" "C:\Maps\Temp\Contours_5m.kml"

4. Copy this kml file into the overlays folder in the oruxmaps folder on the Android (12) phone at.
Internal storage\Android\data\com.orux.oruxmapsDonate\files\oruxmaps\overlay

View the kml file in Google Earth. (File - Open). It is a text file and can viewed and edited in Notepad. Eg the line colour and width can be changed.
Open Oruxmaps. Tap Map icon at top right. Select a suitable map, eg Open Street Map or OpenAndroMap etc. Then Tap Map icon again. Overlay options - Load kml file. Tap kml file. It opens as a transparent overlay of the 5m contours.
This also worked with DEM .tif files. But the files "C:\Program Files\GDAL\projlib\proj.db" and 2 other proj files had to be copied into the GDAL folder.

Making contours and lots more can be done with Qgis. But Qgis has a steep learning curve, and is a 1+ GB download, and 2.4+ GB disk space.

If .prj projection files are not available, the projection data can be added to the gdalbuildvrt file using the -a_srs option. The projection data may be included in a metadata file or in the DEM file name itself.
For example, the ASC DEM file 'PNOA_MDT05_ETRS89_HU30_0179_LID.asc' is a DEM file based on a 5 metre grid from north east Spain, from the website 'http://centrodedescargas.cnig.es/CentroDescargas/catalogo.do?Serie=LIDA2'
The projection data is ETRS89 Zone30N and is included in the filename. The gdalbuildvrt -a_srs option requires a EPSG number. A google search shows that EPSG:25830 and EPSG:3042 may be the correct values.
So the gdalbuildvrt statement is:
gdalbuildvrt -a_srs EPSG:25830 "C:\Maps\Temp\All_ASC_Files.vrt" "C:\Maps\Temp\*.asc"

The file 'PNOA_MDT05_ETRS89_HU30_0179_LID.asc' represents an area approx 28kms by 19kms and is a 190MB file. The KML file produced for this area is about 625MB. This is a very large file and may cause slow operation.
A smaller area of interest can be selected from the large .asc file by using the -te Xmin Ymin Xmax Ymax option for gdalbuildvrt. Use
gdalinfo "C:\Maps\Temp\PNOA_MDT05_ETRS89_HU30_0179_LID.asc"
to see the corner coordinates of the .asc file. Then use the -te option to select an area within it. For example
gdalbuildvrt -a_srs EPSG:25830 -te 757750 4710040 762750 4715040 "C:\Maps\Temp\All_ASC_Files.vrt" "C:\Maps\Temp\*.asc"
selects an area 5km by 5kms at the lower left corner of the DEM file. This produces a KML file size of about 20MB. The file size can be further reduced by converting it to a KMZ compressed file using the 7-Zip program.

During the last months I worked a lot to create new DTMs, now they are available:

Norway_Mainland v2, Norway_Svalbard v1, Norway_Jan Mayen v1, Denmark_Faroes v1, United Kingdom v2, Ireland v1, Portugal_Mainland v0, Portugal_Madeira v1, Portugal_Azores v1, EUROPE v18

Have fun!

Hello,
Thank you Sonny for your great and good job.
Regards.

Just an update:
Quite a few new DTMs have been released during the last months, especially in Middle- and Eastern Europe.
Have fun with them!

Thanks Sonny, great to see the balkans area to finally start to be included...

Some News:
Fixed Models: Italy v2b, Austria 0.5" v2
New Models: Cyprus v1, Switzerland 0.5" v2