Navigation
Database Coverage
| Table | Rows | Coverage |
|---|---|---|
market_share |
36 | 9 companies · 3 markets · 4 segments · 2024–2025 |
vendor_metrics |
2,869 | SEC fundamentals: Revenue, GrossProfit, OperatingIncome, NetIncome |
prices |
106,413 | 14 tickers · 1972-01-07 to 2026-02-05 · daily OHLCV |
events |
10 | 6 companies · 2024-01-25 to 2025-05-02 · earnings + launches |
Schema Snapshot
market_share
metric_date
market
segment
company
share_pct
source
vendor_metrics
metric_date
period
company
ticker
metric_name
metric_value
prices
trade_date
ticker
open
high
low
close
volume
events
event_date
company
event_type
title
Ingestion Pipeline
SEC Fundamentals
scripts/pull_sec_companyfacts.py — pulls company facts from SEC EDGAR and normalizes vendor metrics.
Price History
scripts/pull_stooq_prices.py — loads daily OHLCV price history for all 14 vendor and benchmark tickers.
Authoritative Share Data
scripts/sources/normalize_authoritative_sources.sh — maps source snapshots into data/manual/*_market_share.csv.
Database Build
scripts/init_db.py — creates and refreshes SQLite tables via idempotent inserts.
Module Layout
domains/Semiconductors/
├── cli/main.py # CLI entry point
├── data/
│ ├── semiconductors.db # SQLite database
│ ├── manual/ # Authoritative share CSVs
│ └── visualizations_html/ # Interactive output artifacts
├── scripts/
│ ├── pull_sec_companyfacts.py
│ ├── pull_stooq_prices.py
│ ├── init_db.py
│ └── bootstrap_data.sh
├── market_share.py
├── price_history.py
├── catalyst_notes.py
├── briefing_builder.py
└── test_domain.py
Bootstrap Commands
| Action | Command |
|---|---|
| Install deps | cd domains/Semiconductors && pip install -r requirements.txt |
| Bootstrap data | ./scripts/bootstrap_data.sh |
| Run tests | python test_domain.py |
| Launch CLI | cd cli && python main.py |