Update datasets requirement from 2.21.0 to 3.1.0 in /backend

[dependabot]

Updates the requirements on datasets to permit the latest version.

Release notes

Sourced from datasets's releases.

3.1.0

Dataset Features

• Video support by @​lhoestq in huggingface/datasets#7230

  >>> from datasets import Dataset, Video, load_dataset
  >>> ds = Dataset.from_dict({"video":["path/to/Screen Recording.mov"]}).cast_column("video", Video())
  >>> # or from the hub
  >>> ds = load_dataset("username/dataset_name", split="train")
  >>> ds[0]["video"]
  <decord.video_reader.VideoReader at 0x105525c70>

• Add IterableDataset.shard() by @​lhoestq in huggingface/datasets#7252

  >>> from datasets import load_dataset
  >>> full_ds = load_dataset("amphion/Emilia-Dataset", split="train", streaming=True)
  >>> full_ds.num_shards
  2360
  >>> ds = full_ds.shard(num_shards=ds.num_shards, index=0)
  >>> ds.num_shards
  1
  >>> ds = full_ds.shard(num_shards=8, index=0)
  >>> ds.num_shards
  295

• Basic XML support by @​lhoestq in huggingface/datasets#7250

What's Changed

• (Super tiny doc update) Mention to_polars by @​fzyzcjy in huggingface/datasets#7232
• [MINOR:TYPO] Update arrow_dataset.py by @​cakiki in huggingface/datasets#7236
• Missing video docs by @​lhoestq in huggingface/datasets#7251
• fix decord import by @​lhoestq in huggingface/datasets#7255
• fix ci for pyarrow 18 by @​lhoestq in huggingface/datasets#7257
• Retry all requests timeouts by @​lhoestq in huggingface/datasets#7256
• Always set non-null writer batch size by @​lhoestq in huggingface/datasets#7258
• Don't embed videos by @​lhoestq in huggingface/datasets#7259
• Allow video with disabeld decoding without decord by @​lhoestq in huggingface/datasets#7262
• Small addition to video docs by @​lhoestq in huggingface/datasets#7263
• fix docs relative links by @​lhoestq in huggingface/datasets#7264
• Disallow video push_to_hub by @​lhoestq in huggingface/datasets#7265

New Contributors

• @​fzyzcjy made their first contribution in huggingface/datasets#7232

Full Changelog: huggingface/datasets@3.0.2...3.1.0

Commits

• dfb52e2 Release: 3.1.0 (#7270)
• f8e3321 Disallow video push_to_hub (#7265)
• 46e4616 fix docs relative links (#7264)
• b08f762 Small addition to video docs (#7263)
• 1946182 Allow video with disabeld decoding without decord (#7262)
• f75f489 Don't embed videos (#7259)
• ff0149f Always set non-null writer batch size (#7258)
• 444ce83 Retry all requests timeouts (#7256)
• a9c610f fix ci for pyarrow 18 (#7257)
• 91e9313 fix decord import (#7255)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)