Spark troubleshooting
Skill whchoi98/aws-skills-for-claude-code/skills/spark-troubleshooting
Troubleshoot Spark applications on AWS EMR, Glue, and SageMaker - analyze failures, identify bottlenecks, get code recommendations. Use when mentioning Spark, EMR, PySpark, Glue Spark, or Spark troubleshooting.From its SKILL.md
npx -y skills add whchoi98/aws-skills-for-claude-code --skill spark-troubleshootingAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
2 things to look at
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
- 20 stars20 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
1.0 KB, as published. Nobody here has run it
Spark Troubleshooting Agent
Key Capabilities
- Failure analysis for PySpark and Scala jobs
- Root cause identification via telemetry correlation
- Performance diagnostics and bottleneck detection
- Code recommendations and optimizations
- Supports EMR EC2, EMR Serverless, Glue, SageMaker
MCP Servers
- sagemaker-unified-studio-mcp-troubleshooting — Failure analysis
- sagemaker-unified-studio-mcp-code-rec — Code recommendations
Best Practices
- Provide specific identifiers (cluster ID, application ID, job ID)
- Describe symptoms clearly (observed vs expected)
- Include exact error messages
- Specify platform (EMR EC2, EMR Serverless, Glue, SageMaker)
Setup
Requires CloudFormation stack deployment for IAM role. See AWS docs for setup.