r/learndatascience 2d ago

Original Content Async batch faker: A vectorized mock data generetor

Post image

I'm currently student and am building a portfolio so i created this library which im calling Async batch faker. So if you have used standard faker you already know that "Faker" is good at generating a single row but generating a bit more takes forever because it operates on pythons standard for loop.
So what i made async batch faker do is that it uses numpy and asyncio to calculate mathematical data and string concatenations instantly in C. It bypasses Python loops to blast hundreds of thousands of rows of localized data in seconds

Benchmark:
Standard Faker: ~348 seconds
Async Batch Faker: ~8.4 seconds (41x faster)

GitHub: [https://github.com/haiderkashan/fast_faker_poc\]
PyPI: pip install async-batch-faker

I'm just a rookie must have made mistakes would love to hear feedbacks

1 Upvotes

0 comments sorted by