Real-Time AI Defect Detection in Automotive Body Shop | iFactoryAi

By Josh Brook on October 8, 2026

real-time-ai-defect-detection-automotive-body-shop

A car body can carry up to 4,000 spot welds, plus studs, sealer and panels that must all be right before paint. Manual checks and weld tear-downs see only a sample, so a missing weld or dented panel often shows up after paint, when it costs far more to fix. Real-time AI checks every body at line speed, in the station that made the defect, and holds it for repair on the spot. To see it on one of your stations, book a body shop vision session.

Automotive · Body Shop · Live Detection Stream

Real-Time AI Defect Detection in the Automotive Body Shop

Multi-camera deep learning checks welds, studs, sealer and panel surfaces on every body, at line speed. Defects are classified in milliseconds, on servers inside your plant, so the fix happens before the body reaches paint.

  • What AI vision catches in body-in-white, zone by zone
  • What "real time" has to mean at 60 jobs per hour
  • How it fits a brownfield line, fully on-premise
Live detection stream · framing line6 cameras
Bodies inspected this shift436 5 held for repair431 passed every check at line speed
Body 22817 · weld nugget missing, B-pillarHold
Body 22816 · studs and nuts all presentPass
Body 22815 · sealer bead continuousPass
Body 22814 · roof panel, no dents foundPass
NextRepair bay notified with the image and weld location.
One body shop line, illustrative.
Where AI vision looks on a body-in-whitecommon checks by zone

Underbody

Spot weldsStuds and nutsBrackets

Side frames

Weld positionSpatterSealer bead

Roof and pillars

Missing weldsLaser braze seamDents and dings

Closures

Hem qualityAdhesive beadPanel marks

Front end

Bolts and clipsWeld nutsFit of parts

Whole body

Part presenceRight variantBody ID match

Which checks run where depends on your stations. Most plants start with the zones that cause the most repairs after paint, then add zones once the first station has proved itself.

Up to 4,000spot welds join about 300 sheet metal parts in a car body, a Chalmers study notes
~80%is the industry-average hit rate for human visual inspection, a 2015 Sandia study reports
4.6K/hrinferences in iFactory's Live Detection Stream, about 77 per body at 60 jobs per hour
<10 msper inference in iFactory's spec, against a takt of around a minute per body

Why Body Shop Defects Escape

Thousands of features per body. A few seconds of human attention.

Body shops are among the most automated areas in any plant, but checking is still largely manual or by sampling. Welds are torn down on a few bodies a shift. Studs and sealer are checked by eye, often by people with many other tasks. Panel dents are often spotted only under the bright lights after paint. Our vision support team can help you find where your escapes start.

1

Sampling

Destructive weld checks cover a few bodies a shift, not every one, and take hours to complete.

2

Reflective metal

Bare steel and aluminium glare under light, hiding small dents until paint shows them up.

3

Robot drift

A worn tip or shifted fixture repeats the same fault on every body that follows.

4

Late discovery

Many defects show only after paint, when repair is far costlier and slower.

At the station

Seconds

Re-weld or fit the stud while the body is still in place and easy to reach.

End of body shop

Minutes

Body pulled to a repair bay. Access may be harder once more parts are on.

After paint

Hours

Repair, then repaint or touch-up. Costs and lost capacity climb fast.

In the field

Warranty

The most expensive place by far, and the worst for the brand and the customer.

One robot, many bodies

A human error usually affects one body. A robot or fixture fault affects every body until someone notices. That is why real-time detection matters most in the body shop: catching the first bad body stops the next fifty.

What AI Vision Catches in the Body Shop

Some checks are easy wins. Others need care, and some need another tool.

Deep learning handles variation in shape, glare and position far better than fixed rules, and it can be retrained when a model or part changes. It is very good at presence, position and visible quality. It cannot see inside a weld. To match checks to your stations, book a station mapping call.

Defect
What the camera sees
What it cannot confirm
Pair it with
Missing spot weld
No weld mark where one should be
Nugget size and strength inside
Weld controller data, ultrasonic checks
Weld position
Weld mark off its target point
Fusion depth
Robot path and tip dressing records
Spatter and burrs
Metal beads and sharp edges on surfaces
Effect on later sealing
Downstream sealer check
Studs and weld nuts
Present, in place, right type
Weld strength of the stud
Stud welder process data
Sealer and adhesive
Bead present, continuous, in position
Exact bead volume
3D bead sensors where needed
Dents and dings
Surface marks on outer panels
Very shallow marks on some lighting
Dedicated lighting tunnel
Lighting is half the job

Bare steel and aluminium reflect light in ways that hide or fake defects. Diffuse, shielded lighting and the right camera angle often do more for accuracy than a bigger model. Plan the light with the camera, not after it.

Usually the first wins

  • Missing welds, studs and nuts
  • Sealer bead gaps
  • Wrong part for the variant
  • Obvious spatter on visible faces

Need more set-up

  • Small dents on bare reflective panels
  • Hem quality on closures
  • Weld points hidden by fixtures
  • Mixed steel and aluminium bodies

Inside One Takt

At 60 jobs per hour, each body spends about a minute per station. Here is how the vision checks fit inside that minute.

One body, one stationillustrative
Takt time at 60 jobs per hour60 s
Inferences per body, at 4.6K per hour~77
Time per inference, iFactory spec<10 ms
All inferences for one body, end to end<1 s
Takt left to react and hold the body59 s+
77 × 10 ms is under one second of compute. Camera trigger and line signals add a little more, tested during the pilot.

What Real Time Has to Mean

Fast enough to stop the body at the station, not just to report it later.

"Real time" is easy to claim. In a body shop it means a decision before the body moves on, and a signal the line can act on. That needs the cameras, the compute and the line link all planned together, and tested on the real line. If you want help with a station plan, our engineers can help.

1

Trigger

Body in position. All cameras fire together.

2

Infer

Each image checked on the edge server in milliseconds.

3

Classify

Defect type, location and severity named for the operator.

4

Signal

Pass, or hold sent to the line.

5

Route

Repair bay gets the image and exact spot.

6

Trace

Result stored against the body ID for traceability.

Plan for false alarms

A system that holds good bodies will be switched off within a week. Run the models beside current checks first, measure false holds as carefully as misses, and switch the line hold on only when both are at a level the line accepts.

Speed

Inside takt

Decision and signal well inside the station's cycle, with margin to spare on the busiest shift.

Coverage

Every body

All bodies checked, not a sample. Coverage is not the same as catching every defect.

Action

A real hold

A defect that only appears on a report is an audit, not error-proofing.

Brownfield Lines and On-Premise AI

Most body shops are not new. The system has to fit the line you have.

Brownfield lines have fixed robots, tight spaces, older PLCs and little spare downtime. Cameras go where they can see clearly without blocking robots or maintenance access, and the AI runs on servers inside the plant, so no images need to leave the site. To plan a fit for your line, book a brownfield fit check.

Brownfield fit

  • Cameras. Mounted clear of robot paths.
  • Light. Shielded, steady lighting for bare metal.
  • Trigger. From existing body-in-position signals.
  • Signals. Standard industrial links to the line PLC.

On-premise by design

  • Images and models stay inside your network
  • No cloud link needed for detection
  • Works through internet outages
  • Fits plant IT and security rules

A retrofit in four moves

1

Survey

Walk the station with your engineers and mark camera and light positions on the layout.

2

Mount

Fit cameras and lights during a planned stop, clear of robot paths and safety zones.

3

Shadow

Run detection beside current checks, with no line hold yet, for several weeks.

4

Switch on

Turn on the hold once catch rate and false holds are agreed with quality.

Questions plant IT will ask, and short answers

  • Where do images go? To a server inside your plant network, nowhere else.
  • Does it need the internet? Not to detect defects. Remote support is optional and agreed with IT.
  • Who can see the data? Named users with their own logins.
  • What if the server fails? The line runs as before, with an alert raised.
Example exchange · illustrative
Body shop engineerWhy were three bodies held on the framing line this morning?
iFactory AIAll three had a missing weld at the same point on the left B-pillar, from robot R12. The misses started at 06:42, just after a tip change.
Body shop engineerIs it still happening?
iFactory AINo. The robot was re-taught at 07:05 and the next 31 bodies passed. The three held bodies have been repaired and re-checked.

How iFactory's Live Detection Stream Works

Multi-camera deep learning, at the line, on your own servers.

iFactory's Live Detection Stream runs multi-camera deep learning models on edge servers in the plant. iFactory specifies around 4,600 inferences an hour with under 10 ms per inference. Models are trained on images of your own bodies, including real defects, and checked by your quality team before the line hold goes live. Questions on fit go to our support desk.

1

See

Several cameras per station, triggered together as the body arrives, each covering its own zone.

2

Detect

Deep learning finds and classifies defects in each image.

3

Act

Hold, alert or route to repair, through the line PLC.

4

Learn

Repeat faults traced to robots, tips or fixtures, so the cause is fixed, not just the body.

What the line sees

  • Pass or hold for every body
  • The image with the defect marked
  • Where to send the body for repair

What engineers see

  • Defects by robot, station and shift
  • Faults that start after tip or tool changes
  • Trends before they become escapes

The pilot scorecard

Measure 1

Catch rate

Share of real defects found, by defect type, against your own audit of the same bodies.

Measure 2

False holds

Good bodies flagged by mistake, per shift, and why they were flagged.

Measure 3

Timing

Decision time against takt, on the busiest shift of the week.

Measure 4

Repairs after paint

The number that shows whether the station has paid off.

Detection rates depend on the station, lighting and defect type. We measure them on your own bodies during the pilot, against your own audits, rather than promising a general figure.

Turnkey AI: Delivered, Connected and Live in 6–12 Weeks

You do not build this. It arrives ready.

iFactory ships as a pre-configured NVIDIA AI server, racked and ready, with the software pre-loaded. Rack it, plug in power and Ethernet, and the AI is live on your network.

Our team handles cabling, network setup, PLC and SCADA integration, operator training and 24×7 remote monitoring. The server sits inside your own network, so images and production data stay on site. For a scope matched to your body shop, request a turnkey quote.

Weeks 1–4

Ship, network and data

Server and cameras installed at the pilot station. Body ID and line signals connected and tested.

Weeks 5–8

Model training and pilot

Models trained on your bodies and run beside current checks. Results compared.

Weeks 9–12

Go-live and training

Line hold switched on once results are agreed. Body shop and quality teams trained on the new workflow. 24×7 remote monitoring begins.

Live in 6–12 weeksfrom delivery to a live detection station
1000+ clientsacross industrial operations
99.9% uptimewith 24×7 remote monitoring

Frequently Asked Questions

What is real-time AI defect detection in a body shop?

Cameras and deep learning models check each body as it passes a station, find defects such as missing welds, studs or sealer gaps, and decide in milliseconds, so the body can be held and repaired before it moves on. Each result is stored against the body ID.

Can AI vision check spot weld quality?

It can confirm a weld is present and in the right place, and flag visible problems such as spatter. It cannot see the nugget inside. Weld controller data and ultrasonic or destructive checks still prove strength. Vision adds full coverage of what can be seen.

Will it slow the line down?

It should not. Inference takes milliseconds per image on servers at the line, leaving most of the takt free. Timing is tested in the pilot before the line hold is switched on, on the busiest shifts and with every camera running.

Does it catch every defect?

No system catches every defect. It inspects every body, which is not the same thing. Catch rates are measured during the pilot against your own audits, defect type by defect type, and shared openly with your team.

Does any data go to the cloud?

Not for detection. Models run on servers inside your network, and images stay on site. Any remote support link is agreed with your IT team and can be switched off.

Can it work on an older brownfield line?

Usually, yes. Cameras are placed clear of robots, and the system uses existing body-in-position and line signals. A site survey confirms which stations fit best, and where cameras can see without blocking robots or people.

How do we start?

With one station that causes the most repairs after paint. A 6-week pilot installs cameras, trains models on your bodies and runs them beside your current checks, so results can be compared fairly before anything changes on the line. To plan it, contact our team.

Stop the Next Bad Body at the Station

In thirty minutes we look at your body shop repairs and escapes, pick the station most likely to pay back first, and sketch the cameras and checks it would need. You keep the plan whether or not you go further with iFactory.

Five things worth bringingif you have them
  • 1Repairs found after paint, by defect type
  • 2Weld and stud audit results
  • 3Photos of your problem stations
  • 4Line rate and station cycle times
  • 5How body ID is tracked on the line

Share This Story, Choose Your Platform!