File Geodatabase

A file geodatabase is an Esri geospatial data format that stores and manages spatial and nonspatial data. It can store various types of geographic data, including nonspatial tables, feature classes, feature datasets, and raster datasets.

GeoAnalytics Engine supports loading tables and feature classes of point, multipoint, line, and polygon geometries. After loading the file geodatabase into a Spark DataFrame, you can perform analysis and visualize the data by using the SQL functions and tools available in GeoAnalytics Engine in addition to functions offered in Spark.

The following table shows the Python syntax for loading the file geodatabase into a Spark DataFrame.

When you load the file geodatabase, specify the path of the file geodatabase and the name of the table or feature class using the below options.

If you don't specify the gdbName, the complete catalog of the datasets in the file geodatabase will be loaded.

Above is an example view of a file geodatabase in the ArcGIS Pro Catalog pane. When you load the catalog for the file geodatabase named example.gdb, the table catalog includes the dataset name, Name, the dataset type, DatasetType, and the geometry type, GeometryType, for each table and feature class.

1
2
3
4
# Load the file geodatabase catalog from an S3 bucket
spark.read.format("filegdb").option("gdbPath", "s3a://my-bucket/my-folder/example.gdb").load().show()

1
2
3
4
5
6
7
8
9
+-------------+-------------+------------+
|         Name|  DatasetType|GeometryType|
+-------------+-------------+------------+
|ca_population|        Table|        null|
|     ca_parks|Feature Class|       Point|
|     us_lakes|Feature Class|     Polygon|
|    us_rivers|Feature Class|    Polyline|
|        calls|Feature Class|  MultiPoint|
+-------------+-------------+------------+

Usage notes

• GeoAnalytics Engine will load the date or the timestamp offset data type in a table or feature class as a TimestampType column. For the timestamp offset data type, the time offset will be applied and not maintained in the TimestampType column after loading to a Spark DataFrame. If there is one TimestampType column in the Spark DataFrame, it will be automatically set as the time field. If there are multiple TimestampType columns, you can call st.set_time_fields() to enable time.

• GeoAnalytics Engine will load the date only data type as a DateType column, and will map the time only data type to a string column representing the 24-hour time in the format HH:mm:ss.

• The table or feature class name is unique in a file geodatabase. To load the table or feature class in a feature dataset, you can access the data with gdbName without specifying the name or path to the feature dataset. In the above example, you can load the feature class us_lakes with syntax spark.read.format("filegdb").option("gdbPath", "s3a://my-bucket/my-folder/example.gdb").option("gdbName", "us_lakes").load().

• When GeoAnalytics Engine accesses a file geodatabase, it will not lock the table, feature class, or feature dataset. You can freely edit or modify the file geodatabase with other processes such as ArcGIS Pro.

• When loading the catalog of the file geodatabase, the name of the feature dataset is not included in the table catalog.

• GeoAnalytics Engine does not support loading mosaic datasets or raster datasets stored in a file geodatabase.

• GeoAnalytics Engine does not support saving data into file geodatabases.