I like what you folks have done with this product.
@dagsterio
6 ай бұрын
Thanks - there is a lot more in store coming next month!
@quinnherden
6 ай бұрын
+1 I am rooting for you guys. Thank you for all of your hard work
@dagsterio
6 ай бұрын
We appreciate it - thanks @@quinnherden !
@shaounakn
6 ай бұрын
@@dagsterio Sure, thanks for making these sessions, these are really helpful.
@jordanfox470
2 ай бұрын
Is there native support for mapping time based partitions to static partitions defined like "today", "rest of month", "rest of year", "rest of history"? This is a common setup for power bi datasets, which can be represented as assets in dagster. Would be nice to take advantage of auto materialize policies.
@dagsterio
2 ай бұрын
Dagster does not natively support mapping time-based partitions to static partitions like "today," "rest of month," "rest of year," and "rest of history" directly out of the box. However, you can achieve similar functionality by defining custom partitioning schemes and using the appropriate partition mappings. You can define custom partitions using StaticPartitionsDefinition for static and TimeWindowPartitionsDefinition for time-based partitions.
@kludgedude
Ай бұрын
Integrate or replace slurm?
@user-yh1hx9pe7u
6 ай бұрын
@dagsterio Do you have the source of the demo avaialble somewhere?
@dagsterio
6 ай бұрын
All the code for the demos from the deep dives are in this repository ( github.com/dagster-io/devrel-project-demos )! This one in particular is in the partitions directory.
@Jahaniam
5 ай бұрын
@@dagsterio unfortunately it is private/ link is broken.
@dagsterio
2 ай бұрын
@@Jahaniam Sorry, the final parenthesis got included by KZitem in the URL - try this: github.com/dagster-io/devrel-project-demos
Пікірлер: 12