Explanation:
Box 1: Delta
With Microsoft OneLake integration for semantic models, data imported into model tables can also be automatically written to Delta tables in OneLake. The Delta format is the unified table format across all compute engines in Microsoft Fabric. OneLake integration exports the data with all key performance features enabled to provide more seamless data access with higher performance.
Data scientists, database analysts, app developers, data engineers, and other data consumers can then access the same data that drives your business intelligence and financial reports in Power BI. T-SQL, Python, Scala, PySpark, Spark SQL, R, and no-code/low-code solutions can all be used to query data from Delta tables.
Box 2: Tables/productline1
How to Save a Pyspark Dataframe as a Table in a Fabric Warehouse
Example, save the dataframe result as a table in my Lakehouse.:
tf_df.write.format("delta").mode("append").save("Tables/actual_weather")
Scenario: Data Preparation Requirements
Contoso identifies the following data preparation requirements:
* The Research division data for Productline1 must be retrieved from Lakehouse1 by using Fabric notebooks.
* All the Research division data in the lakehouses must be presented as managed tables in Lakehouse explorer.
Reference:
https://learn.microsoft.com/en-us/power-bi/enterprise/onelake-integration-overview
https://medium.com/the-data-therapy/how-to-save-a-pyspark-dataframe-as-a-table-in-a-fabric-warehouse-e3b04915f066