IL3.1C1 - Computer Vision System for Operator Ergonomics and Security

An edge-computing computer-vision system for operator ergonomics and security in industrial tasks. It includes danger-zone detection, task monitoring and picking navigation, and hand/glove tracking, with laboratory validation under a Bosch-defined case study.

  • Main Gain(s): Operator safety monitoring, Task navigation support, Glove-aware assembly validation, Human digital-twin data capture

  • Use Case(s): Controlled laboratory case studies reproducing industrial picking tasks and Bosch safety scenarios involving moving bridge equipment

  • Start TRL: TRL 2

  • Final TRL: TRL 5

  • Main Contributions: Universidade de Aveiro (coord. Prof. Eugénio Rocha; support Diogo Costa) with Bosch Termotecnologia, S.A. (coord. Eng. Nelson Ferreira)

Main Features

    </th>
    <th class="px-3 py-3 text-center font-semibold">Batch Data</th>
    <th class="px-3 py-3 text-center font-semibold">Web App</th>
    <th class="px-3 py-3 text-center font-semibold">Real-Time Data</th>
    <th class="px-3 py-3 text-center font-semibold">Control Tower Integration</th>
    <th class="px-3 py-3 text-center font-semibold">REST API</th>
    <th class="px-3 py-3 text-center font-semibold">Containerized Application</th>
    <th class="px-3 py-3 text-center font-semibold">Extensible</th>
  </tr>
</thead>

<tbody class="divide-y divide-slate-100">

  <!-- Optional second row example -->
  <tr class="transition hover:bg-slate-50">
    <td class="sticky left-0 z-10 bg-white px-4 py-3 font-medium text-slate-900">
      Product Capabilities
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-rose-100 text-rose-700">X</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-amber-100 text-amber-700">~</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-emerald-100 text-emerald-700">✓</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-emerald-100 text-emerald-700">✓</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-rose-100 text-rose-700">X</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-emerald-100 text-emerald-700">✓</span>
    </td>

    <td class="px-3 py-3 text-center">
      <span class="inline-flex h-6 w-6 items-center justify-center rounded-full bg-emerald-100 text-emerald-700">✓</span>
    </td>
  </tr>
</tbody>
  • Danger-detection platform using regions of interest and intrusion simulation
  • Task Monitoring and Picking Navigation with accuracy reported at or above 94.5% across tested scenarios
  • Hand and glove tracking with multi-region validation
  • Edge devices with GPU/TPU support and environmental sensing
  • Laboratory setup replicating industrial picking and operator-safety scenarios