OverviewHistoryStatsSecurity
npx skills add ...
Documentation
SKILL.md
npx skills add alleneubank/claude-code --skill web-fetch
Fetches web content as clean markdown by preferring markdown-native responses and falling back to selector-based HTML extraction. Use for documentation, articles, and reference pages at http/https URLs.
npx skills add alleneubank/claude-code --skill web-fetch
Fetch web content in this order:
content-type: text/markdown)Verify required tools before extracting:
Install Bun dependencies for the bundled script:
Use this as the default flow for any URL:
| Site | Include Selector | Exclude Selector |
|---|---|---|
| platform.claude.com | #content-container | - |
| docs.anthropic.com | #content-container | - |
| developer.mozilla.org | article | - |
| github.com (docs) | article | nav,.sidebar |
| Generic | article,main,[role=main] | nav,header,footer,script,style |
Example:
When a site isn't in the patterns list:
When selectors produce poor output, run the bundled parser:
If already in the skill directory:
Empty output with selectors: The page might be markdown-native. Check headers first:
Wrong content selected: The site may have multiple article/main regions:
html2markdown not found: Install it, then retry selector-based extraction.
bun or script deps missing: Run cd ~/.claude/skills/web-fetch && bun install.
Missing code blocks: Check if the site uses non-standard code formatting.
Client-rendered content: If HTML only has "Loading..." placeholders, the content is JS-rendered. Neither curl nor the Bun script can extract it; use browser-based tools.
cd ~/.claude/skills/web-fetch && bun installURL="<url>"
CONTENT_TYPE="$(curl -sIL "$URL" | awk -F': ' 'tolower($1)=="content-type"{print tolower($2)}' | tr -d '\r' | tail -1)"
if echo "$CONTENT_TYPE" | grep -q "markdown"; then
curl -sL "$URL"
else
curl -sL "$URL" \
| html2markdown \
--include-selector "article,main,[role=main]" \
--exclude-selector "nav,header,footer,script,style"
ficurl -sL "<url>" \
| html2markdown \
--include-selector "#content-container" \
--exclude-selector "nav,header,footer"# Check what content containers exist
curl -s "<url>" | grep -o '<article[^>]*>\|<main[^>]*>\|id="[^"]*content[^"]*"' | head -10
# Test a selector
curl -sL "<url>" | html2markdown --include-selector "<selector>" | head -30
# Check line count
curl -sL "<url>" | html2markdown --include-selector "<selector>" | wc -lbun ~/.claude/skills/web-fetch/fetch.ts "<url>"bun fetch.ts "<url>"--include-selector "CSS" # Keep only matching elements
--exclude-selector "CSS" # Remove matching elements
--domain "https://..." # Convert relative links to absolutecurl -sIL "<url>" | grep -i '^content-type:'curl -s "<url>" | grep -o '<article[^>]*>'