Write to feature services

GeoAnalytics for Microsoft Fabric supports saving a feature service in ArcGIS Online or ArcGIS Enterprise with the Spark DataFrameWriter.

Steps

Import

1. In your notebook, import geoanalytics_fabric.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   
   import geoanalytics_fabric

Write to feature services using the Spark DataFrameWriter

1. Register a GIS with the ArcGIS Online or Portal for ArcGIS user that the feature service is shared with.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   
   geoanalytics_fabric.register_gis("myGIS", "https://arcgis.com", username="User", password="p@ssw0rd")

2. Load a polygon feature service of world continents into a Spark DataFrame. The field shape is the geometry column of the DataFrame.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   3
   4
   
   url = "https://services.arcgis.com/P3ePLMYs2RVChkJx/arcgis/rest/services/World_Continents/FeatureServer/0"
   df = spark.read.format("feature-service").load(url)
   df.select("FID", "CONTINENT", "SQMI", "SQKM", "Shape_Area", "shape").show()
   Result

   Use dark colors for code blocksCopy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   12
   +---+-------------+--------------+--------------+-------------+--------------------+
   |FID|    CONTINENT|          SQMI|          SQKM|   Shape_Area|               shape|
   +---+-------------+--------------+--------------+-------------+--------------------+
   |  1|       Africa|1.1583462724E7|3.0001150784E7|2559.07309772|{"rings":[[[39505...|
   |  2|         Asia|1.7317280092E7|4.4851729022E7|5432.08522748|{"rings":[[[-2.00...|
   |  3|    Australia|  2973612.2055|   7701651.076|695.539920644|{"rings":[[[1.768...|
   |  4|      Oceania|  165678.71418|  429107.61696|42.5654703343|{"rings":[[[2.003...|
   |  5|South America|  6856255.3355|1.7757690859E7|1539.31293336|{"rings":[[[-7481...|
   |  6|   Antarctica|  4754809.4571| 1.231494924E7|6054.02150735|{"rings":[[[-2.00...|
   |  7|       Europe| 3821854.34569|  9898596.9251|1444.39561322|{"rings":[[[26548...|
   |  8|North America|  9339528.4866|2.4189364532E7| 3708.7527567|{"rings":[[[-9092...|
   +---+-------------+--------------+--------------+-------------+--------------------+

3. Write the spatially enabled DataFrame of US world continents into a feature service layer using Spark DataFrameWriter. The service name must be unique. If the layer name is not specified, the service name will be the layer name.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   
   service_name = "continents"
   df.write.format("feature-service") \
           .option("gis", "myGIS") \
           .option("serviceName", service_name) \
           .option("layerName", "layer") \
           .option("tags", "continents, boundaries") \
           .option("description", "This is an example feature service showing boundaries of world continents") \
           .save()

4. Overwrite an existing layer with a Spark DataFrame of North America continent boundaries using Spark DataFrameWriter. When loading the feature service layer back, there is one feature (Continent North America) in the layer.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   
   north_america = df.where("continent = 'North America'")
   
   # You can check the service URL in the ArcGIS Online Contents after saving the Spark Dataframe
   service_url = "https://<host>/<uniqueID>/ArcGIS/rest/services/<serviceName>/FeatureServer"
   north_america.write.format("feature-service") \
                .option("gis", "myGIS") \
                .option("serviceUrl", service_url) \
                .option("layerName", "layer") \
                .mode("overwrite") \
                .save()

5. Append to an existing layer with a Spark DataFrame of South America continent boundaries using Spark DataFrameWriter. When loading the feature service layer back, there are two features (North America and South America) in the layer.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   
   south_america = df.where("continent = 'South America'")
   # You can check the service URL in the ArcGIS Online Contents after saving the Spark Dataframe
   south_america.write.format("feature-service") \
                .option("gis", "myGIS") \
                .option("serviceUrl", service_url) \
                .option("layerName", "layer") \
                .mode("append") \
                .save()

6. Append to an existing layer with a Spark DataFrame of Europe continent boundaries using option truncate is true. All records in the existing layer will be removed before appending the DataFrame. When loading the feature service layer back, there is one feature (Europe) in the layer.

   PythonPythonScala
   Use dark colors for code blocksCopy

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   
   europe = df.where("continent = 'Europe'")
   # You can check the service URL in the ArcGIS Online Contents after saving the Spark Dataframe
   europe.write.format("feature-service") \
         .option("gis", "myGIS") \
         .option("serviceUrl", service_url) \
         .option("layerName", "layer") \
         .option("truncate", "true") \
         .mode("append") \
         .save()

What's next?

Learn about how to write out other data types or analyze your data through SQL functions and analysis tools:

• Data sources
• Read and write shapefiles
• Using DataFrames
• Tools
• SQL Functions