Event page: www.meetup.com...
*Talk* (40min talk, 10min Q&A)
Title: Bigger but local: Tools for uncomfortably big data
Abstract: Sooner or later, every data scientist faces a dataset big enough to require thought about how to handle it without blowing up the machine. We'll talk about three tools which both make it easier to handle bigger data locally and scale nicely to cloud architecture when required:
1. Parquet. We all want more data, but nobody really wants a 281 Gb CSV. Parquet is a well-supported alternative that solves a lot of the problems with CSVs.
2. Arrow Datasets. (Experimental!) What do you do when you've got more data than memory? Arrow Datasets are a really easy-to-use option to pull out what you need.
3. Apache Drill. When you need a power tool, Drill lets you treat a hard drive like a database, putting the power of SQL at your fingertips without the setup.
And thanks to our open-source community, they all work beautifully from R! Join us and learn how to scale up your data engineering skills.
**Speaker**: Edward Visel
Edward Visel is a data scientist at Uptake, a Chicago startup that detects problems in machines in the industrial internet of things before they cause catastrophic failures. In previous lives he worked in education and politics; in his spare time he, like everyone else, bakes bread.
**Code of Conduct**: github.com/laR...
*Schedule*
6:30 open zoom
6:40-7:20 Presentation
7:20-7:30 Q&A
~8:00 Virtual Social
*LA R Users Group*
Invite yourself to our Slack group: socalrug.herok...
Ask us any questions by email: larusers@gmail.com
Find our previous talks on GitHub: github.com/laR...
Follow us on Twitter: @la_Rusers
Check out more events: laocr.org/
**** DON'T BE SHY ******
Reach out if you want to be our speaker. First-time speakers are welcome
Негізгі бет LA R Users - September 22 Meeting 2020 - Bigger but local: Tools for uncomfortably big data
No video
Пікірлер