Research Methodology

How We Score Products

The complete, transparent explanation of how Motion Labs synthesizes owner intelligence and calculates our Motion Score™. We show our work so you can judge the quality of our intelligence yourself.

The Core Philosophy

Traditional review sites test one unit for two weeks and call it a verdict. We believe that's statistically insufficient — one tester's experience is an anecdote, not data. A product with 4,000 verified owner reviews represents 4,000 real-world use cases across different homes, climates, lifestyles, and usage patterns.

Our methodology extracts, weights, and synthesizes this distributed intelligence into a single structured verdict. The result is a score that improves over time as more owner data arrives — something a lab test can never achieve.

The 5-Step Intelligence Process

1

We Gather the Signal

We collect owner experience data from four primary sources, each with strict quality filters:

  • Amazon verified purchase reviews — Verified purchase badge required. Minimum 30 words. Single-sentence reviews excluded.
  • Reddit community posts — Account age over 6 months required. Upvote ratio above 70% required. Relevant communities only (r/BuyItForLife, category-specific subs).
  • YouTube owner review transcripts — Videos 10+ minutes, published 3+ months ago, owner-framed titles ("after 6 months", "long term review").
  • Cross-retailer reviews — Best Buy, Home Depot, Target. Used to detect Amazon review manipulation via rating discrepancy analysis.
2

We Apply Intelligence Weighting

Not all reviews are equal. We weight them based on ownership duration and verification status:

  • Reviews mentioning 6+ months of ownership receive 2× weight — long-term owner signal is the most reliable data point
  • Verified purchase reviews receive 1.5× weight over unverified reviews
  • Reviews 18+ months old receive 0.7× weight for fast-evolving tech categories (firmware, software, product revisions)
  • Cross-source confirmation — same complaint appearing on Amazon, Reddit, AND YouTube is flagged as a confirmed signal, not noise
3

We Cross-Reference Manufacturer Claims

For every key specification, we compare what the manufacturer claims against what owners consistently report. Coverage area. Noise level. Battery life. Filter lifespan. Energy consumption. We flag overstated claims prominently in our Spec Accuracy column.

Example: A manufacturer claims 1,500 sq ft coverage. If 60%+ of owners in 800-1,000 sq ft spaces report incomplete coverage, we flag the claim as overstated and adjust the Spec Accuracy Score accordingly.

4

We Calculate the Motion Score™

The Motion Score is a transparent, four-component weighted composite displayed on every product page:

Motion Score™ (0–10)
Owner Satisfaction Score    → 35%  (aggregated sentiment, verified reviews)
Spec Accuracy Score        → 25%  (manufacturer claims vs. owner-reported reality)
Long-Term Reliability Score → 25%  (reviews flagged 3+ months of ownership)
Value Rating               → 15%  (owner price-to-satisfaction sentiment)
5

We Monitor and Update Continuously

Scores are not static. Major firmware updates, product revisions, or shifts in owner sentiment trigger a re-evaluation. Price changes automatically update the Value Rating component. Scores published more than 6 months ago without a review update are flagged for re-evaluation. Every page displays a "Last Updated" date so you always know how fresh the data is.

What We Don't Do

❌ We don't fabricate reviews

Our AI synthesizes real owner reviews. It does not generate fictional opinions or product descriptions.

❌ We don't sell score influence

No brand payment or relationship ever influences a Motion Score. The algorithm is mathematically seeded only by owner data.

❌ We don't recommend by commission rate

We earn the same Amazon commission regardless of the product price in a category. Our incentive is accuracy, not upsell.

❌ We don't ignore negative data

Regret rates, recurring complaints, and spec accuracy failures are given equal weight to positive signals.

See it in action

Browse our most thoroughly researched product category.

Browse Air Purifier Reviews →