Section 3.5 · Field Benchmarks & Audio Conformer

Tested on real metal and raw sound.

Two models work together inside your phone: a purpose-built acoustic Conformer neural net that hears mechanical failures at high accuracy, and a grounded language model that checks every answer against 38,729 verified service manual records. Here is how they respond across 26 real-world test cases.

3.5.1

The Audio Conformer: Highly Accurate Acoustic Diagnosis

Mechanical failures do not whisper in generalities—they announce themselves with precise physical frequencies. A spun connecting rod bearing hammers at half crankshaft speed. A stretched timing chain whips against its plastic guides on cold morning starts. A dying turbocharger creates a distinct compressor whine under load. A dry alternator bearing squeals with alternator rotor RPM.

To capture these signatures, Check Engine Chat runs an on-device Audio Conformer neural network. The Conformer combines depthwise separable convolutional layers (to detect local spectral patterns like harmonic knock pulses) with multi-head self-attention (to model temporal duration and engine rev transitions).

Trained on real recordings gathered at car meets and active repair bays across 58 distinct mechanical fault categories, the Conformer achieves ultra-high accuracy on real mechanical recordings, executing in sub-second inference completely offline on Apple Silicon and mobile Neural Engines.

ACOUSTIC CONFORMER SPECIFICATION VERIFIED ARCHITECTURE
> INPUT SAMPLING: 16,000 Hz RAW WAV
> SPECTRAL TRANSFORM: 80-BIN LOG MEL FILTERBANK
> WINDOW / HOP: 25ms WINDOW / 10ms STRIDE
> ENCODER: CONFORMER (ATTENTION + CONV)
> ACOUSTIC CLASSES: 58 SYSTEM FAULT STATIONS
> LATENCY: < 200ms ON APPLE NEURAL ENGINE
> NETWORK CALLS: 0 (100% PRIVATE & ON-DEVICE)
Fig 1. Real-time audio inference profile executed on-device.
3.5.2

The Grounded Mechanic: Verified Data, Zero Guessing

An acoustic prediction alone is only half the repair. A driver hearing a whine needs to know: is this normal gear mesh, an alternator bearing, or a failing power steering pump on their specific vehicle?

Check Engine Chat connects the Audio Conformer directly to a customized 4-bit quantized automotive language model trained in a rigorous two-pass grounding architecture:

  • Pass 1 (Diagnostic Decomposition): The model extracts your vehicle’s exact year, make, model, engine family, and reported acoustic symptoms to form targeted database queries.
  • Pass 2 (Grounded Synthesis): The model cross-references the retrieved factory service records with the Conformer’s acoustic confidence classes, delivering an authoritative technical answer.

The language model answers strictly from our verified 38,729-entry database of factory manuals, service bulletins, and maintenance schedules. If a specification is not documented, it states what is known rather than inventing numbers.

Core DimensionCheck Engine Chat Implementation
Acoustic ClassifierHigh-accuracy Conformer tower (58 faults)
Automotive Knowledge38,729 verified factory manual records
Fluid SpecificationsExact OEM weights, specs & dry/wet capacities
Torque SpecsFactory bolt torque values in lb-ft / Nm
Known Platform TSBsCataloged by engine code, generation & year
Offline ArchitectureRuns fully inside your device memory
3.5.3

The 26 Production Test Runs

To market and validate real-world expectations, our test harness runs a unified test battery combining genuine recorded mechanical faults with technical owner inquiries. Below are the unedited outputs from all 26 production test cases:

CASE #01 2021 BMW M340i
• bad_timing_chain.mp3
Diagnostic Inquiry
“What transmission fluid does the ZF 8-speed automatic take on my 2021 M340i?”
Acoustic Conformer On-Device Tower
> 1. timing issues100.0%
> 2. engine knock94.6%
> 3. engine tick94.0%
Grounded Mechanic Synthesis · Verified Manual

For your 2021 BMW M340i, the ZF 8-speed automatic requires ZF Lifeguard 8 (with part number BMW 83 22 2 289 720) as the transmission fluid.

CASE #02 2017 Honda Accord V6
• Boost leak whistle.mp3
Diagnostic Inquiry
“What are the common symptoms of VCM (Variable Cylinder Management) issues on my 2017 Accord V6?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. boost leak100.0%
> 3. wastegate rattle95.1%
Grounded Mechanic Synthesis · Verified Manual

Symptoms of VCM (Variable Cylinder Management) system issues on a 2017 Accord V6 include:

Excessive oil consumption

Check Engine Light (MIL) with misfire codes

Rough idle or vibration at highway speeds

Fouled spark plugs

Additionally, these models may experience reduced power and white/blue smoke from the exhaust when VCM systems malfunction.

CASE #03 2023 Tesla Model 3
• power steering pump.mp3
Diagnostic Inquiry
“What is the wheel lug nut torque specification for my 2023 Model 3?”
Acoustic Conformer On-Device Tower
> 1. belt pulley issues100.0%
> 2. power steering100.0%
> 3. ac compressor95.3%
Grounded Mechanic Synthesis · Verified Manual

The wheel lug nut torque specification for your 2023 Model 3 is 129 lb-ft.

CASE #04 2019 Chevrolet Silverado 1500
• Rod knock or lifters 4.6 V8 mustang GT.mp3
Diagnostic Inquiry
“What are the common symptoms of AFM lifter failure on my 2019 Silverado 5.3L?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. rod knock100.0%
> 3. exhaust leak97.2%
Grounded Mechanic Synthesis · Verified Manual

Verdict: While there is no direct mention of "lifter failure" specifically for the 2019 Silverado 5.3L in the dataset, there is information regarding AFM-related issues:

Ticking or knocking noise from engine

Misfires, which may present as rough idle or loss of power

Check Engine Light

Excessive oil consumption

Note that the database indicates these symptoms relate to the 2019 Chevrolet Silverado model year within its coverage range (2019-2026).

CASE #05 2016 Mazda MX-5 Miata
• Transmission whine - change transmission fluid and filter.mp3
Diagnostic Inquiry
“What is the stock wheel bolt pattern and center bore for my 2016 ND Miata?”
Acoustic Conformer On-Device Tower
> 1. transmission fault100.0%
> 2. turbo failure98.6%
> 3. boost leak98.6%
Grounded Mechanic Synthesis · Verified Manual

For the 2016 ND Mazda MX-5 Miata, the stock wheel specifications are:

Bolt Pattern: 5x114.3mm

Center Bore: 67.1mm

CASE #06 2020 Subaru Crosstrek
• Transmission slip off acceleration.mp3
Diagnostic Inquiry
“When should I replace the spark plugs on my 2020 Crosstrek?”
Acoustic Conformer On-Device Tower
> 1. transmission fault100.0%
> 2. wastegate rattle98.6%
> 3. differential whine98.2%
Grounded Mechanic Synthesis · Verified Manual

Based on the maintenance schedule data available:

  • Spark Plugs: Should be replaced every 60,000 miles.
CASE #07 2018 Volkswagen GTI
• From Cabin - Wastegate rattle.mp3
Diagnostic Inquiry
“When should I replace the spark plugs on my 2018 GTI?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. rattle100.0%
> 3. wastegate rattle100.0%
Grounded Mechanic Synthesis · Verified Manual

The recommended replacement interval for spark plugs on your 2018 Volkswagen GTI is every 60,000 miles according to the maintenance schedule data available.

Additional Information:

Spark plug type mentioned is NGK BKR7EIX.

Standard maintenance interval: 40,000 miles per VW specifications.

  • Tuned cars may require replacement at 30,000 miles due to accelerated wear.
CASE #08 2021 Ford F-150
• severe boost leak.mp3
Diagnostic Inquiry
“What is the lug nut torque specification for my 2021 F-150?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. boost leak100.0%
> 3. transmission fault98.6%
Grounded Mechanic Synthesis · Verified Manual

For the 2021 Ford F-150, the Lug Nut Torque specification is:

  • Lug Nuts: 150 lb-ft
CASE #09 2015 Lexus RX350
• spark knock pre-ignition caused by a lean fuel mix and timing.mp3
Diagnostic Inquiry
“What water pump issue is common on the RX350 around 100K miles?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. vtec failure95.5%
> 3. ac compressor94.7%
Grounded Mechanic Synthesis · Verified Manual

For the Lexus RX350, a common water pump issue around 100,000 miles is characterized by a light growl or pink coolant crust at the weep hole, which indicates it is a normal wear point and should be replaced at first occurrence of such symptoms.

CASE #10 2022 Hyundai Palisade
• VW Bad timing sound - Timing Chain , cam phaser, tensioner and hydraulic lifter.mp3
Diagnostic Inquiry
“What engine oil weight and capacity does the 3.8L engine in my 2022 Hyundai Palisade take?”
Acoustic Conformer On-Device Tower
> 1. timing issues100.0%
> 2. engine tick100.0%
> 3. heat shield rattle95.8%
Grounded Mechanic Synthesis · Verified Manual

The 3.8L engine in a 2022 Hyundai Palisade requires 0W-20 oil with a capacity of 5.4 quarts.

CASE #11 2019 Audi Q5
• 2014 Chevy Sonic 1.8L ticking.mp3
Diagnostic Inquiry
“What engine oil specification and capacity does my 2019 Audi Q5 2.0T take?”
Acoustic Conformer On-Device Tower
> 1. engine tick100.0%
> 2. ac compressor95.1%
> 3. timing chain94.9%
Grounded Mechanic Synthesis · Verified Manual

For the 2019 Audi Q5 2.0T, the engine oil specification and capacity are as follows:

Oil Type: VW 502.00 5W-40

Capacity: 5.5 quarts

CASE #12 2014 Jeep Grand Cherokee
• Honda Engine Rattle at Startup - vtec actuator.mp3
Diagnostic Inquiry
“What are the common symptoms of TIPM failure on my 2014 Jeep Grand Cherokee?”
Acoustic Conformer On-Device Tower
> 1. vtec failure100.0%
> 2. vtec engagement100.0%
> 3. wheel bearing94.4%
Grounded Mechanic Synthesis · Verified Manual

Based solely on the database records for a 2014 Jeep Grand Cherokee, the common symptoms of TIPM (Totally Integrated Power Module) failure include:

  • Intermittent no-start condition
  • Fuel pump not priming or running continuously
  • Headlights/wipers activating randomly
  • Engine stalling unexpectedly

The database also notes related diagnostic codes B162B, U0100, and U0140 for this issue.

CASE #13 2020 Kia Telluride
• Duramax Turbo Noise (Whine) [Issue - Motor mounts worn out].mp3
Diagnostic Inquiry
“What engine and horsepower rating does my 2020 Kia Telluride have?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. wastegate rattle97.4%
> 3. ac compressor97.2%
Grounded Mechanic Synthesis · Verified Manual

The 2020 Kia Telluride is equipped with a 3.8L Lambda II V6 engine producing 291 hp at 6000 rpm.

CASE #14 2018 Porsche 911 GT3
• Audi A4 Turbo rattleticking sound (Code P0299) [Needed new Turbocharger].mp3
Diagnostic Inquiry
“What are the nominal brake rotor dimensions for standard iron brakes on a 991.2 GT3?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. engine tick100.0%
> 3. differential whine96.0%
Grounded Mechanic Synthesis · Verified Manual

For the 2017-2019 Porsche 911 GT3 (991.2), the standard iron brake rotor dimensions are:

Front rotors: 380 mm x 34 mm nominal thickness

Rear rotors: 380 mm x 30 mm nominal thickness

CASE #15 2023 Toyota Tacoma V6
• Tapping Knocking noise coming from Subaru ej25 SOHC - idler pulley.mp3
Diagnostic Inquiry
“What engine oil weight and capacity does the 3.5L V6 engine take on my 2023 Tacoma?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. head gasket overheat93.1%
> 3. timing chain90.5%
Grounded Mechanic Synthesis · Verified Manual

Engine Oil Weight: 0W-20

Capacity: 5.5 quarts

CASE #16 2019 Chevrolet Corvette
• P2649 Honda Accord v6 vtec solenoid failure symptom doesn't Rev past 3500 RPM.mp3
Diagnostic Inquiry
“What is the correct oil capacity for my 2019 Corvette Stingray?”
Acoustic Conformer On-Device Tower
> 1. vtec failure100.0%
> 2. vtec solenoid100.0%
> 3. wastegate rattle94.1%
Grounded Mechanic Synthesis · Verified Manual

The correct oil capacity for your 2019 Chevrolet Corvette Stingray is 8.5 quarts.

CASE #17 2018 Honda CR-V
• Engine Noise_ Bad Engine Oil, Bad Water Pump, Bad Drive Belt.......mp3
Diagnostic Inquiry
“How often should I change the cabin air filter on my 2018 Honda CR-V?”
Acoustic Conformer On-Device Tower
> 1. belt pulley issues100.0%
> 2. serpentine belt100.0%
> 3. starter motor94.7%
Grounded Mechanic Synthesis · Verified Manual

For your 2018 Honda CR-V, you should change the cabin air filter every 15,000 miles.

CASE #18 2021 Ford Bronco
• Sparkplug Pre-Detonation PingingKnocking Sound.mp3
Diagnostic Inquiry
“What coolant should I use in my 2021 Bronco 2.7L?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. engine tick97.1%
> 3. ac compressor97.0%
Grounded Mechanic Synthesis · Verified Manual

For your 2021 Ford Bronco 2.7L, you should use OEM-spec long-life coolant.

CASE #19 2017 Toyota Highlander
• is this an engine knock sound_.mp3
Diagnostic Inquiry
“My 2017 Highlander has a hesitation when accelerating from a stop. Transmission issue?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. cv joint94.5%
> 3. timing chain94.4%
Grounded Mechanic Synthesis · Verified Manual

Verdict: Yes, your hesitation when accelerating from a stop may be related to a transmission issue as outlined below.

Symptoms Matched: Hesitation or lurch when accelerating from a stop or at low-speed roll-ons; sometimes a clunky 2-1 downshift coming to a stop.

Affected Model/Year: This issue applies to the 2017 Toyota Highlander (part of the 3rd Gen series).

Root Cause: It is identified as a calibration issue involving shift and torque-converter lockup logic within the Direct Shift 8AT (UA80) system introduced in 2017.

Solution: Toyota released a transmission software update (ECM/TCM recalibration) that revises these functions. This fix is applied free at dealers under TSB coverage.

  • Severity: Low-Medium. Note: Fluid changes do not resolve this; you should ask the dealer for the latest calibration.
CASE #20 2016 Ford Focus ST
• 2001 325 Ci Pinging sound.mp3
Diagnostic Inquiry
“What is the recommended spark plug gap for a 2016 Focus ST?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. spark knock100.0%
> 3. boost leak95.4%
Grounded Mechanic Synthesis · Verified Manual

For the 2016 Ford Focus ST, the factory spark plug gap is specified as:

  • 0.028 inches (equivalent to 0.7 millimeters) based on the 2013-2018 Ford Focus ST (2.0L EcoBoost) specification provided by the Database.
CASE #21 2015 Subaru Outback
• Audi A3, S3 GTI Golf R, Engine knocking sound - Camshaft oil actuator.mp3
Diagnostic Inquiry
“How frequently should I replace the serpentine belt on my 2015 Outback 2.5i?”
Acoustic Conformer On-Device Tower
> 1. engine knock100.0%
> 2. cv joint96.9%
> 3. ac compressor94.6%
Grounded Mechanic Synthesis · Verified Manual

The serpentine belt on your 2015 Outback 2.5i should typically be replaced by 100,000 miles or immediately at the first sign of glazing (such as shiny ribs), cracking, or a cold-start squeak that does not go away.

CASE #22 2022 Rivian R1T
• squeaking noise alternator belt.mp3
Diagnostic Inquiry
“My 2022 Rivian R1T has a clunking noise from the front suspension over bumps.”
Acoustic Conformer On-Device Tower
> 1. belt pulley issues100.0%
> 2. alternator whine100.0%
> 3. vacuum leak93.1%
Grounded Mechanic Synthesis · Verified Manual

Based on your query about the clunking noise from the front suspension over bumps:

Symptoms: Clunking or ticking noise from the front suspension when going over bumps, stopping, or during low-speed turns.

Cause: Front half shaft (CV axle) spline lash at the outer joint.

Fix: Rivian service adds a wave washer/spacer kit or replaces the half shaft assembly; this remedy is covered under the comprehensive warranty for most vehicles.

Additional Diagnostic Note: While upper control arm bushings are noted as the second most common source of similar issues in some contexts, the specific issue identified here relates directly to the front half shaft CV axle.

CASE #23 2021 BMW X5
• AC compressor noise.mp3
Diagnostic Inquiry
“What is the brake fluid replacement interval for a 2021 BMW X5?”
Acoustic Conformer On-Device Tower
> 1. ac compressor100.0%
> 2. belt pulley issues95.3%
> 3. power steering95.3%
Grounded Mechanic Synthesis · Verified Manual

For the 2021 BMW X5, the brake fluid replacement interval is every 24 months or 30,000 miles. The fluid is hygroscopic, meaning it absorbs moisture over time which reduces its boiling point.

CASE #24 2018 Chevrolet Colorado
• Turbo charger noise bad turbo charger.mp3
Diagnostic Inquiry
“When should I change the transmission fluid in my 2018 Chevy Colorado V6?”
Acoustic Conformer On-Device Tower
> 1. turbo failure100.0%
> 2. belt pulley issues93.0%
> 3. power steering93.0%
Grounded Mechanic Synthesis · Verified Manual

For your 2018 Chevy Colorado V6, you should change the transmission fluid every 45,000 miles during severe or towing service; this is considered the practical interval for torque-converter shudder prevention.

Transmission Fluid Specifications:

Type: Mobil 1 Synthetic LV ATF HP (blue label)

Service Interval: Every 45,000 miles

Note: Early-production models follow different intervals than later ones based on specific engine configurations.

CASE #25 2019 Audi S4
• K20K24 VTEC rattle.mp3
Diagnostic Inquiry
“What is the correct tire pressure for a 2019 Audi S4 with 19-inch wheels?”
Acoustic Conformer On-Device Tower
> 1. vtec failure100.0%
> 2. ac compressor96.4%
> 3. brake grinding96.1%
Grounded Mechanic Synthesis · Verified Manual

For a 2019 Audi S4 with 19-inch wheels, the recommended tire pressure should be 39 PSI when measuring them cold (not heated by driving). This applies to the 245/35R19 size listed in the vehicle specifications. The document notes that full-load values can vary by several PSI compared to this reading, so always follow the driver-door placard for your specific wheel option.

CASE #26 2020 Ram 1500
• 2001 - 2005 Honda Civic EX - knocking popping noise - (It turned out to be a bad injector oring, however end up having it overheat from a leaking head gasket replaced that, adjusted the lash adjusters and replaced all gaskets..mp3
Diagnostic Inquiry
“My 2020 Ram 1500 5.7L has a ticking noise that gets louder when cold. Exhaust manifold?”
Acoustic Conformer On-Device Tower
> 1. engine knock99.2%
> 2. head gasket overheat99.2%
> 3. timing chain90.2%
Grounded Mechanic Synthesis · Verified Manual

Based on your description of a ticking noise that gets louder when cold, this aligns with the known issue of HEMI Tick related to exhaust manifold failures.

Symptoms:

  • Ticking or tapping noise from the engine, especially during cold starts.
  • The noise often becomes louder under acceleration.

Exhaust smell may be present if there is a leak.

Root Cause:

  • Exhaust manifold bolts are prone to breaking due to thermal cycling (heat expansion/contraction).
  • When a bolt breaks, the manifold pulls away from the head, creating an exhaust leak that sounds like a tick.

Diagnosis:

  • Look for soot or black discoloration around the exhaust manifold flange.
  • A broken bolt will show a gap between the manifold and the head.

Repair:

  • Remove broken bolt (drill and extract), install new stud kit (ARP studs recommended — stronger than factory bolts).
  • Labor can be significant if the broken bolt is difficult to extract.
  • DIY tip: Soak the broken bolt with PB Blaster for 24-48 hours before attempting extraction. Use a left-hand drill bit because sometimes the bolt backs out during drilling.

Note: If you have not yet checked your oil level, it should be done first as many "ticking" complaints are caused by low oil levels.

3.5.4

What to Expect When Using Check Engine Chat

Real-World Diagnostic Expectations

When you hold your phone up to an engine bay or wheel well, here is what to expect from the diagnostic pipeline:

  • Clear Acoustic Triage: The Conformer isolates cyclic mechanical frequencies from background road wash and radiator fan roar, locking onto dominant failure patterns.
  • Exact Platform Specifications: The chat provides precise manufacturer part numbers, torque values, and oil specifications filtered specifically for your year and engine.
  • Documented Fixes: Instead of generic repair platitudes, answers identify root causes—such as worn CV axle spline lash on a Rivian R1T or broken manifold studs on a Ram HEMI.

How to Record for Best Results

The Audio Conformer is highly sensitive and tuned to mechanical frequencies. Follow these simple steps for the clearest diagnosis:

Distance from noise source12 – 18 inches
Recording duration5 – 10 seconds
Engine conditionIdle or steady 2,000 RPM
Accessories (A/C, radio)Turned off
Signal requiredNone (Offline)
3.5.5

Get the app

Put the listening model and the complete automotive service database in your pocket. Runs anywhere your car can break down.