Topic modeling text mining

Skill a5c-ai/babysitter/library/specializations/domains/social-sciences-humanities/humanities/skills/topic-modeling-text-mining

Apply LDA, NMF, and other computational methods to discover patterns in large text corpora with appropriate parameter tuningFrom its SKILL.md

Install

npx -y skills add a5c-ai/babysitter --skill topic-modeling-text-mining

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

2.3 KB, 371 tokens by cl100k_base, as published. Nobody here has run it

Topic Modeling and Text Mining

Apply LDA, NMF, and other computational methods to discover patterns in large text corpora with appropriate parameter tuning.

Overview

This skill enables computational analysis of large text collections. It encompasses topic modeling, text mining techniques, and pattern discovery to reveal structures and themes in textual data for humanistic inquiry.

Capabilities

Topic Modeling

LDA implementation
NMF analysis
Structural topic models
Dynamic topic models
Parameter optimization

Text Preprocessing

Tokenization
Stopword removal
Lemmatization/stemming
N-gram extraction
Document-term matrices

Pattern Discovery

Word frequency analysis
Collocation detection
Named entity recognition
Sentiment analysis
Network extraction

Visualization

Word clouds
Topic distributions
Temporal trends
Network graphs
Interactive displays

Usage Guidelines

Analysis Process

Prepare text corpus
Preprocess documents
Select modeling approach
Tune parameters
Run analysis
Interpret results
Validate findings

Parameter Considerations

Number of topics
Iteration counts
Hyperparameters
Coherence metrics
Validation approaches

Interpretation Guidelines

Examine topic words
Review representative documents
Consider domain knowledge
Validate with close reading
Acknowledge limitations

Integration Points

Related Processes

Text Mining and Distant Reading
Corpus Linguistics Analysis
Network Analysis for Humanities

Collaborating Skills

tei-text-encoding
gis-mapping-humanities
literary-close-reading

References

Digital humanities methodology
Topic modeling tutorials
Text analysis tools
Computational linguistics resources

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.