apologies andy, conda is manual vs. pypi which is automatic

and so tends to lag slightly

It makes total sense. I will build a pypi based approach just to keep fresh. Thank you!

Hi all, Datafold is hosting another Data Quality Meetup on Thursday, November 19th at 9AM PST. It's a virtual event for the most active and hands-on data practitioners to share and discuss tools, ideas & success stories on managing data quality. 📈 We have an amazing list of speakers for the upcoming event including: • Max Gasner (co-author of Dagster) • Scott Breitenother (co-founder of LO) • Dmitry Petrov (co-author of DVC) • Mars Lan (co-author of DataHub) RSVP here If you are curious to learn more about Data Quality Meetup, you can check out the digests and recordings of the previous event

Hi All - thought you might find this interesting: https://twitter.com/asynchio/status/1327732618293510144?s=21

Now sure if anyone here is part of dbt slack, but there is a #tools-dagster channel in there now 🎅

Hey guys! In the setting up guide it says that Dagster optionally collects telemetry. Where do you guys store this -- is it open source and can the community view it?

Hello everyone! Am new to Dagster and trying to get started by next week. Has anyone been successful in running their workflows using Dagster in the new BigSur MacBook that runs on M1 chips? They are planning to replace my machine as my ild one is gonna be dead sooner. Want to check if it works easily as I don’t want to spend time for workarounds with a new, unknown non developer friendly OS, but learn and get started with a POC and move away form airflow slowly! Any kind of recommendations would be much appreciated!

fun Javascript discovery of the day. You cannot

setInterval

or

setTimeout

for “1 month from now”, because that’s too large a number in ms for a 32-bit signed integer. It just rolls over to

1

and runs your code immediately (or in the case of setInterval, runs your code immediately over and over). Relevant to our discussion of GraphQL timestamp types Nick 🙂

great talk at coalesce this morning @Emily!

great coalesce talk @schrockn! dagsir

❗ drizly is hiring a director of data science ❗ check out the details here:  https://jobs.lever.co/drizly/b0cbb791-9034-47c1-8815-c71f6dff334f

Hey, we're hiring too-- for engineering and accounts: https://www.monster.com/jobs/search/?q=accendero-software&where=83404&intcid=skr_navigation_nhpso_searchMain&jobid=222795277

should we have a jobs channel?

dagit is 🤗

Happy new year all, just wanted to drop in my xmas project which may be relevant to everyone containerising their pipelines… Whaler is a visual disk-usage analyser for docker images. It lets you see all the junk you may be inadvertently hauling around in your image, which may be costing you time and money.

FYI a #jobs channel exists here now, and i just posted an exciting sr data scientist opening in Drizly’s growing DS org! 🙂

vscode usability questions: is there a way to get auto-completion or intellisense in vscode to suggest resources (see attachments), or other helpful modules? Also in general I feel the auto-completion is quite off most of the time. Not sure if that is a vscode thing, or if I’m doing something wrong. Any tricks or settings in

settings.json

you use in general with python or dagster specifically? Much appreciated. I started to turn off some suggestions as normally vscode suggested me a huge list with no value at all.

"editor.suggest.filterGraceful": false,
    "javascript.suggest.names": false,
    "editor.wordBasedSuggestions": false,

@Simon Späti VSC's autocomplete is based largely on Python 3 type definitions, which Dagster does not use.

You could write your own detached type definition files, or bug the team to start using type annotations 🙂

Hey all, I’m thinking of building a tool to help with type hint adoption and am curious which python type-checker has most love from the community mypy: Ⓜ️ pyright: 🌴 other (please elaborate): 🅾️ i don’t love any: 🤷 Personally a big fan of pyright as it integrates well in vscode. Wondering if mypy has more stars on gh just because it was released first.

The other one to look at is Pyre

Facebook's attempt

MyPy usually gets features first as it was directly supported by Guido and some others on the CPython team

Some of it depends on audience, like do you care about 3.9's new type hinting support in core collections?

do you care about 3.9's new type hinting support in core collections?

@Noah K my top priority is just getting typehints introduced at all. Sounds like mypy will be first to adopt these new peps (585 in this case?)

Do you mean in Dagster specifically or in your own project?

Dagster will not be able to use 3.9-specific functionality for quite a while.