How to create an array of 1 million cross 1 million in dask?
This recipe helps you create an array of 1 million cross 1 million in dask
Recipe Objective
How to create an array of 1million cross 1million in dask.
The normal Dask schedulers are good enough to work out solely on those blocks that are necessary to attain the required slicing. We produce a Dask array with a trillion components with million part sized blocks. We tend to operate the whole array and at last slice out solely a little of the output Dask continues to return one chunk per input chunk. However, if you have got several repetitions from an identical input chunk, the output chunk might be a lot larger.
Step 1- Importing Libraries.
import dask.array as da
Step 2- Creating a 2million cross 2million array.
y = da.ones((2000000, 2000000), chunks=(500, 500))
Trillion elements array of ones, are now divided into 500 by 500 blocks.
print(y)
What Users are saying..
Savvy Sahai
As a student looking to break into the field of data engineering and data science, one can get really confused as to which path to take. Very few ways to do it are Google, YouTube, etc. I was one of... Read More