Research Papers

Vision-Based Modal Analysis Using Multiple Vibration Distribution Synthesis to Inspect Large-Scale Structures

[+] Author and Article Information
Tadayoshi Aoyama

Department of Micro-Nano Mechanical
Science and Engineering,
Nagoya University Nagoya,
Aichi 4648603, Japan
e-mail: tadayoshi.aoyama@mae.nagoya-u.ac.jp

Liang Li

Process Control Systems Software
Design Department,
Hitachi High-Technologies Corporation,
Tokyo 1058717, Japan
e-mail: liang.li.fg@hitachi-hightech.com

Mingjun Jiang

Department of System Cybernetics,
Hiroshima University,
Higashi-Hiroshima 7898527, Hiroshima, Japan
e-mail: m-jiang@robotics.hiroshima-u.ac.jp

Takeshi Takaki

Department of System Cybernetics,
Hiroshima University,
Higashi-Hiroshima 7898527, Hiroshima, Japan
e-mail: takaki@robotics.hiroshima-u.ac.jp

Idaku Ishii

Department of System Cybernetics,
Hiroshima University,
Higashi-Hiroshima 7898527, Hiroshima, Japan
e-mail: iishii@robotics.hiroshima-u.ac.jp

Hua Yang

State Key Laboratory of Digital
Manufacturing Equipment and Technology,
Huazhong University of Science and Technology,
Wuhan 430073, Hubei, China,
e-mail: huayang@hust.edu.cn

Chikako Umemoto

Keisoku Research Consultant Co.,
Hiroshima 732-0029, Hiroshima, Japan
e-mail: chikakoh@krcnet.co.jp

Hiroshi Matsuda

Department of Structural Engineering,
Nagasaki University,
Nagasaki 8528521, Nagasaki, Japan
e-mail: matsuda@nagasaki-u.ac.jp

Makoto Chikaraishi

Graduate School for International
Development and Cooperation,
Hiroshima University,
Higashi-Hiroshima 7898529, Hiroshima, Japan
e-mail: chikaraishim@robotics.hiroshima-u.ac.jp

Akimasa Fujiwara

Graduate School for International
Development and Cooperation,
Hiroshima University,
Higashi-Hiroshima 7898529, Hiroshima, Japan
e-mail: afujiw@robotics.hiroshima-u.ac.jp

1Corresponding author.

Contributed by the Dynamic Systems Division of ASME for publication in the JOURNAL OF DYNAMIC SYSTEMS, MEASUREMENT,AND CONTROL. Manuscript received October 2, 2017; final manuscript received September 12, 2018; published online November 8, 2018. Assoc. Editor: Youngsu Cha.

J. Dyn. Sys., Meas., Control 141(3), 031007 (Nov 08, 2018) (12 pages) Paper No: DS-17-1502; doi: 10.1115/1.4041604 History: Received October 02, 2017; Revised September 12, 2018

Previously, we proposed a multithread active vision system with virtual multiple pan-tilt tracking cameras by rapidly switching the viewpoints for the vibration sensing of large-scale structures. We also developed a system using a galvanometer mirror that can switch 500 different viewpoints in 1 s. However, the measurement rate of each observation point is low, and the time density is not always sufficient. In addition, strong multiple illuminations are required for the system owing to the retro reflective markers attached to the object being observed. In this study, we propose a multiple vibration distribution synthesis method for vibration analysis that increases the sampling rate of each observation point in the multi-thread active vision system, which is subsequently modified to a system that requires only one illumination by using corner cubes as markers. Several dynamics-based inspection experiments are conducted for a 4 m long truss-structure bridge model. The proposed method and system are verified via a high-order modal analysis, which was impossible to perform in the previous method and system.

Copyright © 2019 by ASME
Your Session has timed out. Please sign back in to continue.


Doebling, S. W. , Farrar, C. R. , Prime, M. B. , and Sheviez, D. W. , 1996, “ Damage Identification and Health Monitoring of Structural and Mechanical Systems From Changes in Their Vibration Characteristics: A Literature Review,” Los Alamos National Laboratory, Los Alamos, NM, Technical Report No. LA-13070-MS.
Hermans, L. , der Auweraer, H. V. , and Mevel, L. , 1999, “ Health Monitoring and Detection of a Fatigue Problem of a Sports Car,” 17th SEM International Modal Analysis Conference, pp. 42–48.
Swamidas, A. S. J. , and Chen, Y. , 1995, “ Monitoring Crack Growth Through the Change of Modal Parameters,” J. Sound Vib., 186(2), pp. 325–343. [CrossRef]
Palacz, M. , and Krawczuk, M. , 2002, “ Vibration Parameters for Damage Detection in Structures,” J. Sound Vib., 249(5), pp. 999–1010. [CrossRef]
Salawu, O. S. , and Williams, C. , 1995, “ Review of Full-Scale Dynamic Testing of Bridge Structures,” Eng. Struct., 17(2), pp. 113–121. [CrossRef]
Qin, Q. , Li, H. B. , Qian, L. Z. , and Lau, C. K. , 2001, “ Modal Identification of Tsing Ma Bridge by Using Improved Eigensystem Algorithm,” J. Sound Vib., 247(2), pp. 325–341. [CrossRef]
Park, K. , Kim, S. , Park, H. , and Lee, K. , 2004, “ The Determination of Bridge Displacement Using Measured Acceleration,” Eng. Struct., 27(3), pp. 371–378. [CrossRef]
Rainieri, C. , and Fabbrocino, G. , 2010, “ Automated Output-Only Dynamic Identification of Civil Engineering Structures,” Mech. Syst. Signal Process., 24(3), pp. 678–695. [CrossRef]
Nassif, H. H. , Gindy, M. , and Davis, J. , 2005, “ Comparison of Laser Doppler Vibrometer With Contact Sensors for Monitoring Bridge Deflection and Vibration,” NDT E Int., 38(3), pp. 213–218. [CrossRef]
Valin, J. , Concalves, E. , and Davis, J. , 2005, “ Methodology for Analysis of Displacement Using Digital Holography,” Opt. Lasers Eng., 43(1), pp. 99–111. [CrossRef]
Kohut, P. , Holak, K. , Uhl, T. , Ortyl, L. , Owerko, T. , Kuras, P. , and Kocierz, R. , 2013, “ Monitoring of a Civil Structureeg State Based on Noncontact Measurements,” Struct. Health Monit., 12(5–6), pp. 411–429. [CrossRef]
Casciati, F. , and Wu, L. , 2013, “ Local Positioning Accuracy of Laser Sensors for Structural Health Monitoring,” Struct. Health Monit., 20(5), pp. 728–739. [CrossRef]
Lee, J. J. , and Shinozuka, M. , 2006, “ Real-Time Displacement Measurement of a Flexible Bridge Using Digital Image Processing Techniques,” Exp. Mech., 46(1), pp. 105–114. [CrossRef]
Feng, D. , Feng, M. , Ozer, E. , and Fukuda, Y. , 2015, “ A Vision-Based Sensor for Noncontact Structural Displacement Measurement,” Sensors, 15(7), pp. 16557–16575. [CrossRef] [PubMed]
Busca, G. , Cigada, A. , Mazzoleni, P. , and Zappa, E. , 2014, “ Vibration Monitoring of multiple bridge Points by Means of a Unique Vision-Based Measuring System,” Exp. Mech., 54(2), pp. 255–271. [CrossRef]
Fukuda, Y. , Feng, M. Q. , Narita, Y. , Kaneko, S. , and Tanaka, T. , 2013, “ Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm,” IEEE Sens. J., 13(12), pp. 4725–4732. [CrossRef]
Kohut, P. , and Kurowski, P. , 2009, “ Application of Modal Analysis Supported by 3D Vision-Based Measurements,” J. Theor. Appl. Mech., 47(4), pp. 855–870. http://www.ptmts.org.pl/jtam/index.php/jtam/article/view/v47n4p855
Morlier, J. , and Michon, G. , 2010, “ Virtual Vibration Measurement Using Klt Motion Tracking Algorithm,” ASME J. Dyn. Syst. Meas. Control, 132(1), pp. 011003–011011. [CrossRef]
Avitabile, P. , Niezrecki, C. , Helfrick, M. , Warren, C. , and Pingle, P. , 2010, “ Noncontact Measurement Techniques for Model Correlation,” Sound Vib., 44(1), pp. 8–12. https://pdfs.semanticscholar.org/5ee5/9f46ee101265426156b961f9e54ce1af73ed.pdf
Caetano, E. , Silva, S. , and Bateira, J. , 2011, “ A Vision System for Vibration Monitoring of Civil Engineering Structures,” Exp. Tech., 35(4), pp. 74–82. [CrossRef]
Chen, J. G. , Wadhwa, N. , Cha, Y. J. , Durand, F. , Freeman, W. T. , and Buyukozturk, O. , 2015, “ Modal Identification of Simple Structures With High-Speed Video Using Motion Magnification,” J. Sound Vib., 345, pp. 58–71. [CrossRef]
Yang, H. , Gu, Q. , Aoyama, T. , Takaki, T. , and Ishii, I. , 2013, “ Dynamics-Based Stereo Visual Inspection Using Multidimensional Modal Analysis,” IEEE Sens. J., 13(12), pp. 4831–4843. [CrossRef]
Zhang, D. , Guo, J. , Lei, X. , and Zhu, C. , 2016, “ A High-Speed Vision-Based Sensor for Dynamic Vibration Analysis Using Fast Motion Extraction Algorithms,” Sensors, 16(4), p. 572. [CrossRef]
Aghajan, H. , and Cavallaro, A. , eds., 2009, Multi-Camera Networks: Principles and Applications, Academic Press, Cambridge, MA.
Wang, X. , 2013, “ Intelligent Multi-Camera Video Surveillance: A Review,” Pattern Recognit. Lett., 34(1), pp. 3–9. [CrossRef]
Aoyama, T. , Li, L. , Jiang, M. , Takaki, T. , Ishii, I. , Yang, H. , Umemoto, C. , Matsuda, H. , Chikaraishi, M. , and Fujiwara, A. , 2018, “ Vibration Sensing of a Bridge Model Using a Multithread Active Vision System,” IEEE/ASME Trans. Mechatronics, 23(1), pp. 179–189. [CrossRef]
Ishii, I. , Tatebe, T. , Gu, Q. , Moriue, Y. , Takaki, T. , and Tajima, K. , 2010, “ 2000 FPS Real-Time Vision System With High-Frame-Rate Video Recording,” IEEE International Conference on Robotics and Automation, Anchorage, AK, May 3–7, pp. 1536–1541.
Yang, H. , Takaki, T. , and Ishii, I. , 2011, “ Simultaneous Dynamics-Based Visual Inspection Using Modal Parameter Estimation,” Rob. Mechatronics, 23(1), pp. 180–195. [CrossRef]
Lynch, J. P. , and Loh, K. J. , 2006, “ A Summary Review of Wireless Sensors and Sensor Networks for Structural Health Monitoring,” Shock Vib. Dig., 38(2), pp. 91–128. [CrossRef]
Cho, S. , Yun, C. , Lynch, J. P. , Zimmerman , A. T., Jr. , Spencer, B. F. , and Nagayama, T. , 2008, “ Smart Wireless Sensor Technology for Structural Health Monitoring of Civil Structures,” Steel Struct., 8(4), pp. 267–275. http://www.kssc.or.kr/wonmun/KSSC_3_2008_8_4_267(C).pdf


Grahic Jump Location
Fig. 1

Overview of the multithread active vision

Grahic Jump Location
Fig. 2

Flowchart of the implemented algorithm

Grahic Jump Location
Fig. 3

Experimental setup

Grahic Jump Location
Fig. 4

Truss-structure bridge model

Grahic Jump Location
Fig. 7

Pan and tilt angles in 15-viewpoint switching: (a) temporal changes and (b) pan-tilt trajectory

Grahic Jump Location
Fig. 8

Binarized images of the captured images for corner reflectors

Grahic Jump Location
Fig. 9

Noise in the high-speed multi-thread active vision system: (a) corner reflector and (b) retroreflective marker

Grahic Jump Location
Fig. 10

Resonant frequency of the bridge model: (a) first-order and (b) second-order

Grahic Jump Location
Fig. 11

Modal shapes of the bridge model: (a) standard deviations of upper chords and (b) standard deviations of lower chords

Grahic Jump Location
Fig. 12

Standard deviation of the modal shape information at each observation point: (a) first-order modal shapes and (b) second-order modal shapes

Grahic Jump Location
Fig. 13

Comparison of modal analysis results between the multi-thread active vision and the vibration indicator unit: (a) first-order modal shapes and (b) deviation

Grahic Jump Location
Fig. 14

Bridge model with multiple loads: (a) same place, different weight, and (b) same weight, different place

Grahic Jump Location
Fig. 15

Modal shapes and evaluation functions with multiple loads: (a) first-order modal shapes, (b) second-order modal shapes, and (c) evaluation functions

Grahic Jump Location
Fig. 16

Bridge model with artificial cracks: (a) C45, C67 of the global scan and (b) C45 of the local scan

Grahic Jump Location
Fig. 17

Modal shapes and evaluation functions with different artificial cracks in the global scan: (a) first-order modal shapes, (b) second-order modal shapes, and (c) evaluation functions

Grahic Jump Location
Fig. 18

Modal shapes and evaluation functions with different artificial cracks in the local scan: (a) modal shapes and (b) evaluation functions



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In