Skip to main content

Historical Analytics (BigQuery)

Vartovii now leverages Google BigQuery to maintain a historical record of all project metrics. This enables trend analysis, predictive modeling, and deep dives into how Trust Scores evolve over time.

🏗️ Architecture

graph LR
A[Cloud Scheduler] -->|Trigger Daily| B[Cloud Run Job]
B -->|Fetch| C[PostgreSQL]
B -->|Transform & Insert| D[BigQuery]
D -->|Analyze| E[AI Reports]

📊 Data Schema

The data is stored in the vartovii_intelligence.daily_snapshots table.

FieldTypeDescription
snapshot_dateDATEPartitioning key (YYYY-MM-DD)
slugSTRINGProject ID (e.g., 'ethereum')
trust_scoreINTThe final score (0-100)
security_scoreFLOATCertik/Audit component
community_scoreFLOATTweetScout component
scam_alertedBOOLFlag if marked as scam

🚀 Key Queries

1. Identify "Rising Stars" (Trust Score +20%)

WITH yesterday AS (
SELECT slug, trust_score FROM `vartovii_intelligence.daily_snapshots`
WHERE snapshot_date = DATE_SUB(CURRENT_DATE(), INTERVAL 1 DAY)
),
today AS (
SELECT slug, trust_score FROM `vartovii_intelligence.daily_snapshots`
WHERE snapshot_date = CURRENT_DATE()
)
SELECT
t.slug,
y.trust_score as prev_score,
t.trust_score as new_score,
((t.trust_score - y.trust_score) / y.trust_score) * 100 as pct_change
FROM today t
JOIN yesterday y ON t.slug = y.slug
WHERE t.trust_score > y.trust_score * 1.2

2. Spot "Rug Pulls" (Security Drops)

SELECT * FROM `vartovii_intelligence.daily_snapshots`
WHERE security_score < 40
AND snapshot_date = CURRENT_DATE()
ORDER BY trust_score DESC

🤖 AI Integration

The Vartovii AI Assistant has access to this data via the get_historical_trends tool (planned), allowing users to ask questions like:

"How has Arbitrum's developer activity changed over last month?"