I'm implementing a Logical datawarehouse with Synapse Serverless SQL.
I have a problem regarding the implementation of SCD 2 for dimensions.
Do you know of any resources that show how to implement it?
Thanks for your help.
Related
I am studying replication protocols while developing a little database in Neo4j. While reading the documentation I have read the definition "core servers" and to me it seems that they are exactly the same as leaders in a multilayer system. Am I missing something?
Core servers handle write transactions.
A core can have one of the following roles : leader or follower.
In a cluster there can be only one leader (and so, tere are many followers)
I have a scenario where I would like to model my IoT asset in a the graph database of DataStax Enterprise. This is a perfect fit for my hierarchical data structure. However, when it comes to my time series data I already have that stored in a separate Cassandra table. Is there a way to bridge the gap between data in the graph database and data in a standard cassandra table?
Thanks
At this current moment, all data needs to reside in DSE Graph tables to be available via Gremlin traversals for OLTP or OLAP use cases. We have features coming out soon though that will help provide an OLAP scenario. We'd love to learn more about your use case though to enhance the product for this type of scenario. If you'd like, please join the DataStax Academy Graph channel and we can discuss this requirement further - https://academy.datastax.com/slack
I have an interview coming up for the role of a data engineer.
Can someone please help me with some resources for complex queries which are used in datawarehouse
eg: querying two fact tables and other complex queries like this
Thanks in advance
Good start point is http://www.kimballgroup.com/
if this work will be with MS SQL Server - good point https://technet.microsoft.com/en-us/virtuallabs
For example, the original SP include several IN parameters and SQLs. Now, I used java application which implemented each SQLs and used Oozie to simulate the whole process/workflow in Oracle SP, not sure if it is the right way. Could you please provide some advices?
Thanks in advance!
You can use CTE (Common Table Expressions) to model your queries. Stored procedures as database objects are not supported in Hive/Impala yet. You may want to have a look here
I am a learner of MVC (4). I have gone through some tutorials on MVC 4. Those are simply awesome. But all of those have used EF with LINQ to SQL for database operation. If i want to use T-SQL for database operation, how can i do it? Should i write sql query in Model or in another library? Where will i place my data access layer?
I googled with this question. But no satisfactory technique found.
I tried to implement my TSQL when I first started doing MVC4 & WPF/WCF. TBH the number of hours I wasted I was probably better off learning the Linq I now know sooner.
I found that if I created a good level of relationships in my database I was able to easily achieve in Linq what I could in TSQL.