Jan 13, 2023 57m
How will you get extra efficiency out of your present information science infrastructure? What if a DataFrame library may reap the benefits of your machine’s accessible cores and supply built-in strategies for dealing with larger-than-RAM datasets? This week on the present, Liam Brannigan is right here to debate Polars.
Episode Sponsor:
Liam is an skilled information scientist working in finance, expertise, and environmental evaluation. He’s lately began contributing to the documentation for Polars and creating a coaching course for the library.
We discuss concerning the library’s general velocity and lack of further dependencies. Liam explains the benefits of lazy vs keen mode and which to decide on when performing information exploration or making an attempt to load a dataset bigger than your RAM.
We additionally focus on potential limitations to switching to Polars from a pandas workflow. Throughout our dialog, we discover a number of different libraries and applied sciences, together with Apache Arrow, DuckDB, question optimization, and the “rustification” of Python instruments.
Course Highlight: Graph Your Data With Python and ggplot
On this course, you’ll discover ways to use ggplot in Python to construct information visualizations with plotnine. You’ll uncover what a grammar of graphics is and the way it might help you create plots in a really concise and constant means.
Present Subjects:
- 00:00:00 – Introduction
- 00:02:06 – Liam’s background and intro to Polars
- 00:03:37 – Hurdles to switching to Polars
- 00:05:23 – Creating coaching assets
- 00:08:15 – No index
- 00:09:46 – Knowledge science 2025 predictions
- 00:12:02 – Contributions to Polars
- 00:15:07 – Keen vs lazy mode & question optimization
- 00:19:25 – Sponsor: Anaconda Nucleus
- 00:20:00 – Apache Arrow and parquet
- 00:24:43 – DuckDB and column orientation
- 00:29:27 – The “rustification” of libraries
- 00:34:49 – Video Course Highlight
- 00:36:16 – GPUs and reminiscence necessities
- 00:45:49 – No further library necessities
- 00:47:37 – Growth of the ecosystem
- 00:51:33 – Chaining operations
- 00:53:39 – How can folks comply with your work?
- 00:54:51 – What are you enthusiastic about on the planet of Python?
- 00:56:09 – What do you need to study subsequent?
- 00:56:58 – Thanks and goodbye
Present Hyperlinks:
Tweet
Share
Share
Email
class=”h4″>
