Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request for system design : Byte Range Fetch and Prefix specification #204

Open
julienlau opened this issue Jan 6, 2022 · 1 comment
Labels
good first issue Good for newcomers

Comments

@julienlau
Copy link

Hi,
Thanks for this very useful tool !

Would it be possible to implement byte range fetch in order to use this tool to benchmark different partitioning scheme :

  • use byte range fetch on 8MB chunks to read 1GB of data from a large single
  • use multiples objects of smaller sizes with the same prefix
  • use multiples objects of smaller sizes with the different prefix

In addition, given the importance of sharding on performance, it would be nice to get a grip on how to use prefix to populate the object store.
Example : option to specify a target of ~100 objects per prefix

Regards

@harshavardhana
Copy link
Member

Feel free to send a PR @julienlau

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants