Generate Offline Map (Overrides)

View on GitHub
Sample viewer app

Take a web map offline with additional options for each layer.

screenshot

Use case

When taking a web map offline, you may adjust the data (such as layers or tiles) that is downloaded by using custom parameter overrides. This can be used to reduce the extent of the map or the download size of the offline map. It can also be used to highlight specific data by removing irrelevant data. Additionally, this workflow allows you to take features offline that don't have a geometry - for example, features whose attributes have been populated in the office, but still need a site survey for their geometry.

How to use the sample

  1. Click on "Generate Offline Map (Overrides)".
  2. Use the range slider to adjust the min/max levelIds to be taken offline for the Streets basemap.
  3. Use the spin-box to set the buffer radius for the streets basemap.
  4. Click the buttons to skip the System Valves and Service Connections layers.
  5. Use the combo-box to select the maximum flow rate for the features from the Hydrant layer.
  6. Use the check-box to skip the geometry filter for the water pipes features.
  7. Click "Start Job"
  8. Wait for the progress view to indicate that the task has completed.
  9. You should see that the basemap does not display when you zoom out past a certain range and is padded around the original area of interest. The network dataset should extend beyond the target area. The System Valves and Service Connections should be omitted from the offline map and the Hydrants layer should contain a subset of the original features.

How it works

The sample creates a PortalItem object using a web map’s ID. This portal item is also used to initialize an OfflineMapTask object. When the button is clicked, the sample requests the default parameters for the task, with the selected extent, by calling OfflineMapTask::createDefaultGenerateOfflineMapParameters. Once the parameters are retrieved, they are used to create a set of GenerateOfflineMapParameterOverrides by calling OfflineMapTask::createGenerateOfflineMapParameterOverrides. The overrides are then adjusted so that specific layers will be taken offline using custom settings.

Streets basemap (adjust scale range)

In order to minimize the download size for offline map, this sample reduces the scale range for the "World Streets Basemap" layer by adjusting the relevant ExportTileCacheParameters in the GenerateOfflineMapParameterOverrides. The basemap layer is used to contsruct an OfflineMapParametersKeyobject. The key is then used to retrieve the specific ExportTileCacheParameters for the basemap and the levelIds are updated to skip unwanted levels of detail (based on the values selected in the UI). Note that the original "Streets" basemap is swapped for the "for export" version of the service - see https://www.arcgis.com/home/item.html?id=e384f5aa4eb1433c92afff09500b073d.

Streets Basemap (buffer extent)

To provide context beyond the study area, the extent for streets basemap is padded. Again, the key for the basemap layer is used to obtain the key and the default extent Geometry is retrieved. This extent is then padded (by the distance specified in the UI) using the GeoemetryEngine::bufferGeodesic function and applied to the ExportTileCacheParameters.

System Valves and Service Connections (skip layers)

In this example, the survey is primarily concerned with the Hydrants layer, so other information is not taken offline: this keeps the download smaller and reduces clutter in the offline map. The two layers "System Valves" and "Service Connections" are retrieved from the operational layers list of the map. They are then used to construct an OfflineMapParametersKey. This key is used to obtain the relevant GenerateGeodatabaseParameters from the GenerateOfflineMapParameterOverrides::generateGeodatabaseParameters property. The GenerateLayerOption for each of the layers is removed from the geodatabse parameters layerOptions by checking for the FeatureLayer::serviceLayerId. Note, that you could also choose to download only the schema for these layers by setting the GenerateLayerOption::queryOption to GenerateLayerQueryOption::None.

Hydrant Layer (filter features)

Next, the hydrant layer is filtered to exclude certain features. This approach could be taken if the offline map is intended for use with only certain data - for example, where a re-survey is required. To achieve this, a whereClause (for example, "Flow Rate (GPM) < 500") needs to be applied to the hydrant's GenerateLayerOption in the GenerateGeodatabaseParameters. The minimum flow rate value is obtained from the UI setting. The sample constructs a key object from the hydrant layer as in the previous step, and iterates over the available GenerateGeodatabaseParameters until the correct one is found and the GenerateLayerOption can be updated.

Water Pipes Dataset (skip geometry filter)

Lastly, the water network dataset is adjusted so that the features are downloaded for the entire dataset - rather than clipped to the area of interest. Again, the key for the layer is constructed using the layer and the relevant GenerateGeodatabaseParameters are obtained from the overrides dictionary. The layer options are then adjusted to set useGeometry to false.

Having adjusted the GenerateOfflineMapParameterOverrides to reflect the custom requirements for the offline map, the original parameters and the custom overrides, along with the download path for the offline map, are then used to create a GenerateOfflineMapJob object from the offline map task. This job is then started and on successful completion the offline map is added to the map view. To provide feedback to the user, the progress property of GenerateOfflineMapJob is displayed in a window.

Relevant API

  • ExportTileCacheParameters
  • GenerateGeodatabaseParameters
  • GenerateLayerOption
  • GenerateOfflineMapJob
  • GenerateOfflineMapParameterOverrides
  • GenerateOfflineMapParameters
  • GenerateOfflineMapResult
  • OfflineMapParametersKey
  • OfflineMapTask

Additional information

For applications where you just need to take all layers offline, use the standard workflow (using only GenerateOfflineMapParameters). For a simple example of how you take a map offline, please consult the "Generate offline map" sample.

Tags

adjust, download, extent, filter, LOD, offline, override, parameters, reduce, scale range, setting

Sample Code

GenerateOfflineMap_Overrides.cppGenerateOfflineMap_Overrides.cppGenerateOfflineMap_Overrides.hDownloadButton.qmlGenerateWindow.qmlOverridesWindow.qmlGenerateOfflineMap_Overrides.qml
Use dark colors for code blocksCopy
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
// [WriteFile Name=GenerateOfflineMap_Overrides, Category=Maps]
// [Legal]
// Copyright 2018 Esri.

// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
// http://www.apache.org/licenses/LICENSE-2.0

// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
// [Legal]

#ifdef PCH_BUILD
#include "pch.hpp"
#endif // PCH_BUILD

#include "GenerateOfflineMap_Overrides.h"

#include "Envelope.h"
#include "FeatureLayer.h"
#include "GeometryEngine.h"
#include "Map.h"
#include "MapQuickView.h"
#include "Portal.h"
#include "PortalItem.h"
#include "OfflineMapTask.h"
#include "Point.h"

using namespace Esri::ArcGISRuntime;

const QString GenerateOfflineMap_Overrides::s_webMapId = QStringLiteral("acc027394bc84c2fb04d1ed317aac674");

QString GenerateOfflineMap_Overrides::webMapId()
{
  return s_webMapId;
}

GenerateOfflineMap_Overrides::GenerateOfflineMap_Overrides(QQuickItem* parent /* = nullptr */):
  QQuickItem(parent)
{
}

void GenerateOfflineMap_Overrides::init()
{
  // Register the map view for QML
  qmlRegisterType<MapQuickView>("Esri.Samples", 1, 0, "MapView");
  qmlRegisterType<GenerateOfflineMap_Overrides>("Esri.Samples", 1, 0, "GenerateOfflineMap_OverridesSample");
}

void GenerateOfflineMap_Overrides::componentComplete()
{
  QQuickItem::componentComplete();

  // find QML MapView component
  m_mapView = findChild<MapQuickView*>("mapView");

  // Create a Portal Item for use by the Map and OfflineMapTask
  const bool loginRequired = false;
  Portal* portal = new Portal(loginRequired, this);
  m_portalItem = new PortalItem(portal, webMapId(), this);

  // Create a map from the Portal Item
  m_map = new Map(m_portalItem, this);

  // Update property once map is done loading
  connect(m_map, &Map::doneLoading, this, [this](Error e)
  {
    if (!e.isEmpty())
      return;

    m_mapLoaded = true;
    emit mapLoadedChanged();
  });

  // Set map to map view
  m_mapView->setMap(m_map);

  // Create the OfflineMapTask with the PortalItem
  m_offlineMapTask = new OfflineMapTask(m_portalItem, this);

  // connect to the error signal
  connect(m_offlineMapTask, &OfflineMapTask::errorOccurred, this, [](Error e)
  {
    if (e.isEmpty())
      return;

    qDebug() << e.message() << e.additionalMessage();
  });

  // connect to the signal for when the default parameters are generated
  connect(m_offlineMapTask, &OfflineMapTask::createDefaultGenerateOfflineMapParametersCompleted,
          this, [this](QUuid, const GenerateOfflineMapParameters& params)
  {
    // Use the parameters to create a set of overrides.
    m_parameters = params;
    m_offlineMapTask->createGenerateOfflineMapParameterOverrides(params);
  });

  connect(m_offlineMapTask, &OfflineMapTask::createGenerateOfflineMapParameterOverridesCompleted,
          this, [this](QUuid /*id*/, GenerateOfflineMapParameterOverrides* parameterOverrides)
  {
    m_parameterOverrides = parameterOverrides;
    emit overridesReadyChanged();
    setBusy(false);
    emit taskBusyChanged();
  });
}

void GenerateOfflineMap_Overrides::setAreaOfInterest(double xCorner1, double yCorner1, double xCorner2, double yCorner2)
{
  // create an envelope from the QML rectangle corners
  const Point corner1 = m_mapView->screenToLocation(xCorner1, yCorner1);
  const Point corner2 = m_mapView->screenToLocation(xCorner2, yCorner2);
  const Envelope extent(corner1, corner2);
  const Envelope mapExtent = GeometryEngine::project(extent, SpatialReference::webMercator());

  // generate parameters
  m_offlineMapTask->createDefaultGenerateOfflineMapParameters(mapExtent);
  setBusy(true);
  emit taskBusyChanged();
}

void GenerateOfflineMap_Overrides::setBasemapLOD(int min, int max)
{
  if (!overridesReady())
    return;

  LayerListModel* layers = m_map->basemap()->baseLayers();
  if (!layers || layers->isEmpty())
    return;

  // Obtain a key for the given basemap-layer.
  OfflineMapParametersKey keyForTiledLayer(layers->at(0));

  // Check that the key is valid.
  if (keyForTiledLayer.isEmpty() || keyForTiledLayer.type() != OfflineMapParametersType::ExportTileCache)
    return;

  // Obtain the dictionary of parameters for taking the basemap offline.
  QMap<OfflineMapParametersKey, ExportTileCacheParameters> dictionary = m_parameterOverrides->exportTileCacheParameters();
  if (!dictionary.contains(keyForTiledLayer))
    return;

  // Create a new sublist of LODs in the range requested by the user.
  QList<int> newLODs;
  for (int i = min; i < max; ++i )
    newLODs.append(i);

  // Apply the sublist as the LOD level in tilecache parameters for the given
  // service.
  ExportTileCacheParameters& exportTileCacheParam = dictionary[keyForTiledLayer];
  exportTileCacheParam.setLevelIds(newLODs);

  m_parameterOverrides->setExportTileCacheParameters(dictionary);
}

void GenerateOfflineMap_Overrides::setBasemapBuffer(int bufferMeters)
{
  if (!overridesReady())
    return;

  LayerListModel* layers = m_map->basemap()->baseLayers();
  if (!layers || layers->isEmpty())
    return;

  OfflineMapParametersKey keyForTiledLayer(layers->at(0));

  if (keyForTiledLayer.isEmpty() || keyForTiledLayer.type() != OfflineMapParametersType::ExportTileCache)
    return;

  // Obtain the dictionary of parameters for taking the basemap offline.
  QMap<OfflineMapParametersKey, ExportTileCacheParameters> dictionary = m_parameterOverrides->exportTileCacheParameters();
  if (!dictionary.contains(keyForTiledLayer))
    return;

  // Create a new geometry around the original area of interest.
  auto bufferGeom = GeometryEngine::buffer(m_parameters.areaOfInterest(), bufferMeters);

  // Apply the geometry to the ExportTileCacheParameters.
  ExportTileCacheParameters& exportTileCacheParam = dictionary[keyForTiledLayer];

  // Set the parameters back into the dictionary.
  exportTileCacheParam.setAreaOfInterest(bufferGeom);

  //  Store the dictionary.
  m_parameterOverrides->setExportTileCacheParameters(dictionary);
}

void GenerateOfflineMap_Overrides::removeSystemValves()
{
  removeFeatureLayer(QStringLiteral("System Valve"));
}

void GenerateOfflineMap_Overrides::removeServiceConnection()
{
  removeFeatureLayer(QStringLiteral("Service Connection"));
}

void GenerateOfflineMap_Overrides::setHydrantWhereClause(const QString& whereClause)
{
  if (!overridesReady())
    return;

  FeatureLayer* targetLayer = getFeatureLayerByName(QStringLiteral("Hydrant"));

  if (!targetLayer)
    return;

  // Get the parameter key for the layer.
  OfflineMapParametersKey keyForTargetLayer(targetLayer);

  if (keyForTargetLayer.isEmpty() || keyForTargetLayer.type() != OfflineMapParametersType::GenerateGeodatabase)
    return;

  // Get the dictionary of GenerateGeoDatabaseParameters.
  QMap<OfflineMapParametersKey, GenerateGeodatabaseParameters> dictionary = m_parameterOverrides->generateGeodatabaseParameters();

  auto keyIt = dictionary.find(keyForTargetLayer);
  if (keyIt == dictionary.end())
    return;

  // Grab the GenerateGeoDatabaseParameters associated with the given key.
  GenerateGeodatabaseParameters& generateGdbParam = keyIt.value();

  ServiceFeatureTable* table = qobject_cast<ServiceFeatureTable*>(targetLayer->featureTable());
  if (!table)
    return;

  // Get the service layer id for the given layer.
  const qint64 targetLayerId = table->layerInfo().serviceLayerId();

  // Set the whereClause on the required layer option.
  QList<GenerateLayerOption> layerOptions = generateGdbParam.layerOptions();
  for (auto& it : layerOptions)
  {
    GenerateLayerOption& option = it;
    if (option.layerId() == targetLayerId)
    {
      option.setWhereClause(whereClause);
      option.setQueryOption(GenerateLayerQueryOption::UseFilter);
      break;
    }
  }

  // Add layer options back to parameters and re-add to the dictionary.
  generateGdbParam.setLayerOptions(layerOptions);

  dictionary[keyForTargetLayer] = generateGdbParam;
  m_parameterOverrides->setGenerateGeodatabaseParameters(dictionary);
}

void GenerateOfflineMap_Overrides::setClipWaterPipesAOI(bool clip)
{
  if (!overridesReady())
    return;

  FeatureLayer* targetLayer = getFeatureLayerByName(QStringLiteral("Main"));

  if (!targetLayer)
    return;

  // Get the parameter key for the layer.
  OfflineMapParametersKey keyForTargetLayer(targetLayer);

  if (keyForTargetLayer.isEmpty() || keyForTargetLayer.type() != OfflineMapParametersType::GenerateGeodatabase)
    return;

  // Get the dictionary of GenerateGeoDatabaseParameters.
  QMap<OfflineMapParametersKey, GenerateGeodatabaseParameters> dictionary = m_parameterOverrides->generateGeodatabaseParameters();

  auto keyIt = dictionary.find(keyForTargetLayer);
  if (keyIt == dictionary.end())
    return;

  // Grab the GenerateGeoDatabaseParameters associated with the given key.
  GenerateGeodatabaseParameters& generateGdbParam = keyIt.value();

  ServiceFeatureTable* table = qobject_cast<ServiceFeatureTable*>(targetLayer->featureTable());
  if (!table)
    return;

  // Get the service layer id for the given layer.
  const qint64 targetLayerId = table->layerInfo().serviceLayerId();

  // Set whether to use the geometry filter to clip the waterpipes.
  // If not then we get all the features.
  QList<GenerateLayerOption> layerOptions = generateGdbParam.layerOptions();
  for (auto& it : layerOptions)
  {
    GenerateLayerOption& option = it;
    if (option.layerId() == targetLayerId)
    {
      option.setUseGeometry(clip);
      break;
    }
  }

  // Add layer options back to parameters and re-add to the dictionary.
  generateGdbParam.setLayerOptions(layerOptions);

  dictionary[keyForTargetLayer] = generateGdbParam;
  m_parameterOverrides->setGenerateGeodatabaseParameters(dictionary);
}

void GenerateOfflineMap_Overrides::takeMapOffline()
{
  if (!overridesReady())
    return;

  // create temp data path for offline mmpk
  const QString dataPath = m_tempPath.path() + "/offlinemap_overrides.mmpk";

  // Take the map offline with the original paramaters and the customized overrides.
  GenerateOfflineMapJob* generateJob = m_offlineMapTask->generateOfflineMap(m_parameters, dataPath, m_parameterOverrides);

  // check if there is a valid job
  if (!generateJob)
    return;

  // connect to the job's status changed signal
  connect(generateJob, &GenerateOfflineMapJob::jobStatusChanged, this, [this, generateJob]()
  {
    // connect to the job's status changed signal to know once it is done
    switch (generateJob->jobStatus()) {
    case JobStatus::Failed:
      emit updateStatus("Generate failed");
      emit hideWindow(5000, false);
      break;
    case JobStatus::NotStarted:
      emit updateStatus("Job not started");
      break;
    case JobStatus::Paused:
      emit updateStatus("Job paused");
      break;
    case JobStatus::Started:
      emit updateStatus("In progress");
      break;
    case JobStatus::Succeeded:
      // show any layer errors
      if (generateJob->result()->hasErrors())
      {
        QString layerErrors = "";
        const QMap<Layer*, Error>& layerErrorsMap = generateJob->result()->layerErrors();
        for (auto it = layerErrorsMap.cbegin(); it != layerErrorsMap.cend(); ++it)
        {
          layerErrors += it.key()->name() + ": " + it.value().message() + "\n";
        }
        emit showLayerErrors(layerErrors);
      }

      // show the map
      emit updateStatus("Complete");
      emit hideWindow(1500, true);
      m_mapView->setMap(generateJob->result()->offlineMap(this));
      break;
    default: // do nothing
      break;
    }
  });

  // connect to progress changed signal
  connect(generateJob, &GenerateOfflineMapJob::progressChanged, this, [this, generateJob]()
  {
    emit updateProgress(generateJob->progress());
  });

  // connect to the error signal
  connect(generateJob, &GenerateOfflineMapJob::errorOccurred, this, [](Error e)
  {
    if (e.isEmpty())
      return;

    qDebug() << e.message() << e.additionalMessage();
  });

  // start the generate job
  generateJob->start();
}

bool GenerateOfflineMap_Overrides::taskBusy() const
{
  return m_taskBusy;
}

bool GenerateOfflineMap_Overrides::overridesReady() const
{
  return m_parameterOverrides;
}


void GenerateOfflineMap_Overrides::removeFeatureLayer(const QString& layerName)
{
  if (!overridesReady())
    return;

  FeatureLayer* targetLayer = getFeatureLayerByName(layerName);
  if (!targetLayer)
    return;

  // Get the parameter key for the layer.
  OfflineMapParametersKey keyForTargetLayer(targetLayer);

  if (keyForTargetLayer.isEmpty() || keyForTargetLayer.type() != OfflineMapParametersType::GenerateGeodatabase)
    return;

  // Get the dictionary of GenerateGeoDatabaseParameters.
  QMap<OfflineMapParametersKey, GenerateGeodatabaseParameters> dictionary = m_parameterOverrides->generateGeodatabaseParameters();

  auto keyIt = dictionary.find(keyForTargetLayer);
  if (keyIt == dictionary.end())
    return;

  // Grab the GenerateGeoDatabaseParameters associated with the given key.
  GenerateGeodatabaseParameters& generateGdbParam = keyIt.value();

  ServiceFeatureTable* table = qobject_cast<ServiceFeatureTable*>(targetLayer->featureTable());
  if (!table)
    return;

  // Get the service layer id for the given layer.
  const qint64 targetLayerId = table->layerInfo().serviceLayerId();

  // Remove the layer option from the list.
  QList<GenerateLayerOption> layerOptions = generateGdbParam.layerOptions();
  for (auto it = layerOptions.begin(); it != layerOptions.end(); ++it)
  {
    if (it->layerId() == targetLayerId)
    {
      layerOptions.erase(it);
      break;
    }
  }

  // Add layer options back to parameters and re-add to the dictionary.
  generateGdbParam.setLayerOptions(layerOptions);

  dictionary[keyForTargetLayer] = generateGdbParam;
  m_parameterOverrides->setGenerateGeodatabaseParameters(dictionary);
}

FeatureLayer* GenerateOfflineMap_Overrides::getFeatureLayerByName(const QString& layerName)
{
  // Find the feature layer with the given name
  LayerListModel* opLayers = m_map->operationalLayers();
  for (int i = 0; i < opLayers->rowCount(); ++i)
  {
    Layer* candidateLayer = opLayers->at(i);
    if (!candidateLayer)
      continue;

    if (candidateLayer->layerType() == LayerType::FeatureLayer && candidateLayer->name().contains(layerName, Qt::CaseInsensitive))
    {
      return qobject_cast<FeatureLayer*>(candidateLayer);
    }
  }
  return nullptr;
}

void GenerateOfflineMap_Overrides::setBusy(bool busy)
{
  m_taskBusy = busy;
  emit taskBusyChanged();
}

bool GenerateOfflineMap_Overrides::mapLoaded() const
{
  return m_mapLoaded;
}

Your browser is no longer supported. Please upgrade your browser for the best experience. See our browser deprecation post for more details.