Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support Databricks fleet clusters #1422

Open
amahussein opened this issue Nov 14, 2024 · 0 comments
Open

[FEA] Support Databricks fleet clusters #1422

amahussein opened this issue Nov 14, 2024 · 0 comments
Labels
? - Needs Triage core_tools Scope the core module (scala) feature request New feature or request user_tools Scope the wrapper module running CSP, QualX, and reports (python)

Comments

@amahussein
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

This is followup on a question posted earlier #1393.
The tools detected that the instance type of the worker is rd-fleet.8xlarge which is in correct. For customers running on Fleet clusters we need to decide on how to support that:

  1. Challenge: Workers can be assigned different instance types (which does not work for our model that assumes homogeneous configurations)
  2. We also need to investigate if it is possible to find the specific instance-type assigned to the workers. In that case, the tools should return something similar to r[0-9]d.8xlarge instead of rd-fleet.8xlarge

Additional context

@amahussein amahussein added ? - Needs Triage core_tools Scope the core module (scala) feature request New feature or request user_tools Scope the wrapper module running CSP, QualX, and reports (python) labels Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
? - Needs Triage core_tools Scope the core module (scala) feature request New feature or request user_tools Scope the wrapper module running CSP, QualX, and reports (python)
Projects
None yet
Development

No branches or pull requests

1 participant