Skip to content

Commit 3a4623c

Browse files
refactor: Utilise parsed length
1 parent 99138e9 commit 3a4623c

File tree

1 file changed

+4
-5
lines changed

1 file changed

+4
-5
lines changed

src/thread/utils/algorithm.py

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -33,17 +33,16 @@ def chunk_split(dataset_length: int, number_of_chunks: int) -> List[Tuple[int, i
3333
------
3434
AssertionError: The number of chunks specified is larger than the dataset size
3535
"""
36-
length = len(dataset)
3736
assert (
38-
length >= number_of_chunks
37+
dataset_length >= number_of_chunks
3938
), 'The number of chunks specified is larger than the dataset size'
4039

41-
chunk_count = length // number_of_chunks
42-
overflow = length % number_of_chunks
40+
chunk_count = dataset_length // number_of_chunks
41+
overflow = dataset_length % number_of_chunks
4342

4443
i = 0
4544
split = []
46-
while i < length:
45+
while i < dataset_length:
4746
chunk_length = chunk_count + int(overflow > 0)
4847
b = i + chunk_length
4948

0 commit comments

Comments
 (0)