Arxiv search

arXiv Search

Search the complete arXiv database of preprints across physics, mathematics, computer science, and quantitative biology using natural language queries powered by Valyu's semantic search API.

Why This Skill is Powerful

• No API Parameter Parsing: Just pass natural language queries directly - no need to construct complex search parameters
• Semantic Search: Understands the meaning of your query, not just keyword matching
• Full-Text Access: Returns complete article content, not just abstracts
• Image Links: Includes figures and images from papers
• Comprehensive Coverage: Access to all of arXiv's preprint archive across multiple disciplines

Requirements

1. Node.js 18+ (uses built-in fetch)
2. Valyu API key from https://platform.valyu.ai ($10 free credits)

CRITICAL: Script Path Resolution

The scripts/search commands in this documentation are relative to this skill's installation directory.

Before running any command, locate the script using:

ARXIV_SCRIPT=$(find ~/.claude/plugins/cache -name "search" -path "*/arxiv-search/*/scripts/*" -type f 2>/dev/null | head -1)

Then use the full path for all commands:

$ARXIV_SCRIPT "quantum entanglement" 15

API Key Setup Flow

When you run a search and receive "setup_required": true, follow this flow:

1. Ask the user for their API key: "To search arXiv, I need your Valyu API key. Get one free ($10 credits) at https://platform.valyu.ai"

2. Once the user provides the key, run:

   scripts/search setup <api-key>
   

3. Retry the original search.

Example Flow:

User: Search arXiv for transformer architecture papers
→ Response: {"success": false, "setup_required": true, ...}
→ Claude asks: "Please provide your Valyu API key from https://platform.valyu.ai"
→ User: "val_abc123..."
→ Claude runs: scripts/search setup val_abc123...
→ Response: {"success": true, "type": "setup", ...}
→ Claude retries: scripts/search "transformer architecture papers" 10
→ Success!

When to Use This Skill

• Searching preprints across physics, mathematics, and computer science
• Finding research before peer review publication
• Cross-disciplinary research combining fields
• Staying current with rapid developments in AI and theoretical physics
• Prior art searching for new ideas
• Tracking emerging research trends

Output Format

{
  "success": true,
  "type": "arxiv_search",
  "query": "quantum entanglement",
  "result_count": 10,
  "results": [
    {
      "title": "Article Title",
      "url": "https://arxiv.org/abs/...",
      "content": "Full article text with figures...",
      "source": "arxiv",
      "relevance_score": 0.95,
      "images": ["https://example.com/figure1.jpg"]
    }
  ],
  "cost": 0.025
}

Processing Results

With jq

# Get article titles
scripts/search "query" 10 | jq -r '.results[].title'

# Get URLs
scripts/search "query" 10 | jq -r '.results[].url'

# Extract full content
scripts/search "query" 10 | jq -r '.results[].content'

Common Use Cases

AI/ML Research

# Find recent machine learning papers
scripts/search "large language model architectures" 50

Physics Research

# Search for quantum physics papers
scripts/search "topological quantum computation" 20

Mathematics

# Find math papers
scripts/search "representation theory and Lie algebras" 15

Computer Science

# Search for CS theory papers
scripts/search "distributed systems consensus algorithms" 25

Error Handling

All commands return JSON with success field:

{
  "success": false,
  "error": "Error message"
}

Exit codes:

• 0 - Success
• 1 - Error (check JSON for details)

API Endpoint

• Base URL: https://api.valyu.ai/v1
• Endpoint: /search
• Authentication: X-API-Key header

Architecture

scripts/
├── search          # Bash wrapper
└── search.mjs      # Node.js CLI

Direct API calls using Node.js built-in fetch(), zero external dependencies.

Adding to Your Project

If you're building an AI project and want to integrate arXiv Search directly into your application, use the Valyu SDK:

Python Integration

from valyu import Valyu

client = Valyu(api_key="your-api-key")

response = client.search(
    query="your search query here",
    included_sources=["valyu/valyu-arxiv"],
    max_results=20
)

for result in response["results"]:
    print(f"Title: {result['title']}")
    print(f"URL: {result['url']}")
    print(f"Content: {result['content'][:500]}...")

TypeScript Integration

import { Valyu } from "valyu-js";

const client = new Valyu("your-api-key");

const response = await client.search({
  query: "your search query here",
  includedSources: ["valyu/valyu-arxiv"],
  maxResults: 20
});

response.results.forEach((result) => {
  console.log(`Title: ${result.title}`);
  console.log(`URL: ${result.url}`);
  console.log(`Content: ${result.content.substring(0, 500)}...`);
});

See the Valyu docs for full integration examples and SDK reference.