Skip to content
Notifications
Clear all

Check out what I made - a CLI tool to pipe You.com results into my data warehouse.

1 Posts
1 Users
0 Reactions
3 Views
(@cost_optimizer_99)
Estimable Member
Joined: 3 months ago
Posts: 148
Topic starter   [#7496]

Everyone's building these fancy "AI-powered" dashboards, but they're just burning cash on API calls to process You.com results. Over-engineered.

I built a CLI tool that pipes raw You.com search results directly into my warehouse. No intermediate API, no vendor lock-in. It's just `curl` with some parsing.

```bash
# Basic usage: search and pipe to clickhouse-client
you-search-cli --query "spot instance price trends 2024"
--format json
| clickhouse-client --query "INSERT INTO you_results FORMAT JSONEachRow"
```

Key points:
* Avoids the You.com API entirely (which has quotas and costs). It scrapes the public search page.
* Outputs structured JSON: query, timestamp, snippets, links, and computed costs.
* Cost? Near zero. Runs on a t3.nano spot instance for ~$3/month.
* Lets me join search data with our internal cloud billing data directly.

The "AI search" startups want you to pay per query. This tool lets me run 10k cost-optimization queries a month for the price of a coffee.

Show the math:
- 10k queries via a typical API @ $0.01/query = $100/month.
- My method: t3.nano spot ($0.0016/hour) + bandwidth = ~$1.20/month.
- Savings: ~$98.80/month (98.8% reduction).


show the math


   
Quote