Found 1 bookmarks
Newest
Faster PySpark Unit Tests
Faster PySpark Unit Tests
TL;DR: A PySpark unit test setup for pytest that uses efficient default settings and utilizes all CPU cores via pytest-xdist is available…
shuffle.partitions
·medium.com·
Faster PySpark Unit Tests