Azure Synapse doesn’t allow for the creation of foreign keys. This is vital for referential integrity between the fact & dimension tables. What alternatives are in synapse to enforce a PK/FK relationship?
@DatahaiBI
2 жыл бұрын
No there is no FK constraint in dedicated/serverless/spark databases. All referential integrity must be dealt with by the ETL/ELT process. This is the same for other cloud MPP data platforms too like Snowflake and Big Query
@krypton0125
11 ай бұрын
nice video! when to use Lake Database and when to use to SQL Database in synapse?
@jeanfabrice9159
8 ай бұрын
I would have asked the same question too !
@krypton0125
7 ай бұрын
@@jeanfabrice9159 did you get the answer?
@jeanfabrice9159
8 ай бұрын
When to use Lake Database and when to use to SQL Database in synapse?
@DatahaiBI
8 ай бұрын
With “SQL Database” do you mean the Serverless SQL Pools or Dedicated SQL pools? Lake databases are used for when you’re workloads in terms of data transformation is done via Spark
@gilgeraldgonong5154
2 жыл бұрын
Able to create external tables. Some tables I can see in the Lake Database and some I do not, weirdly I can see all in sys.external_tables and able to query. Not sure why.
@DatahaiBI
2 жыл бұрын
Hi, how are you creating the external tables in the Lake Database? There are some scenarios where the tables do not appear in the Synapse studio object browser.
@gilgeraldgonong5154
2 жыл бұрын
@@DatahaiBI I am doing something like this spark.catalog.createExternalTable(targetTable, path=SnapshotTarget, source='parquet') Where targetTable is the tablename
@DatahaiBI
2 жыл бұрын
@@gilgeraldgonong5154 Thanks. And I forgot to ask, how did you create the Lake Database? Using Spark?
@7anishok390
Жыл бұрын
Can you please help me.. I have created a lake database external table, I need to load the record from external lakehouse table into Synapse Dedicated SQL Pool table. Please advise.
@DatahaiBI
Жыл бұрын
Hi, what file format is the underlying data? It may be best to use COPY INTO to load the source data into a Dedicated SQL Pools.learn.microsoft.com/en-us/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
Пікірлер: 13