Skip to main content
placeholder image

End-to-end multimodal 16-day hatching eggs classification

Journal Article


Download full-text (Open Access)

Abstract


  • Sixteen-day hatching eggs are divided into fertile eggs, waste eggs, and recovered eggs. Because different categoriesmayhave the same characteristics, they are difficult to classify. Fewexisting algorithms can successfully solve this problem. To this end, we propose an end-to-end deep learning network structure that uses multiple forms of signals. First, we collect the photoplethysmography (PPG) signal of the hatching eggs to obtain heartbeat information and photograph hatching eggs with a camera to obtain blood vessel pictures. Second, we use two different network structures to process the two kinds of signals: Temporal convolutional networks are used to process heartbeat information, and convolutional neural networks (CNNs) are used to process blood vessel pictures. Then, we combine the two feature maps and use the long short-term memory (LSTM) network to model the context and recognize the type of hatching eggs. The system is then trained with our dataset. The experimental results demonstrate that the proposed end-to-end multimodal deep learning network structure is significantly more accurate than using a single modal network. Additionally, the method successfully solves the 16-day hatching egg classification problem.

Authors


  •   Geng, Lei (external author)
  •   Peng, Zhen (external author)
  •   Xiao, Zhitao (external author)
  •   Xi, Jiangtao

Publication Date


  • 2019

Citation


  • L. Geng, Z. Peng, Z. Xiao & J. Xi, "End-to-end multimodal 16-day hatching eggs classification," Symmetry, vol. 11, (6) pp. 759-1-759-14, 2019.

Scopus Eid


  • 2-s2.0-85068095507

Ro Full-text Url


  • https://ro.uow.edu.au/cgi/viewcontent.cgi?article=3935&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2924

Start Page


  • 759-1

End Page


  • 759-14

Volume


  • 11

Issue


  • 6

Place Of Publication


  • Switzerland

Abstract


  • Sixteen-day hatching eggs are divided into fertile eggs, waste eggs, and recovered eggs. Because different categoriesmayhave the same characteristics, they are difficult to classify. Fewexisting algorithms can successfully solve this problem. To this end, we propose an end-to-end deep learning network structure that uses multiple forms of signals. First, we collect the photoplethysmography (PPG) signal of the hatching eggs to obtain heartbeat information and photograph hatching eggs with a camera to obtain blood vessel pictures. Second, we use two different network structures to process the two kinds of signals: Temporal convolutional networks are used to process heartbeat information, and convolutional neural networks (CNNs) are used to process blood vessel pictures. Then, we combine the two feature maps and use the long short-term memory (LSTM) network to model the context and recognize the type of hatching eggs. The system is then trained with our dataset. The experimental results demonstrate that the proposed end-to-end multimodal deep learning network structure is significantly more accurate than using a single modal network. Additionally, the method successfully solves the 16-day hatching egg classification problem.

Authors


  •   Geng, Lei (external author)
  •   Peng, Zhen (external author)
  •   Xiao, Zhitao (external author)
  •   Xi, Jiangtao

Publication Date


  • 2019

Citation


  • L. Geng, Z. Peng, Z. Xiao & J. Xi, "End-to-end multimodal 16-day hatching eggs classification," Symmetry, vol. 11, (6) pp. 759-1-759-14, 2019.

Scopus Eid


  • 2-s2.0-85068095507

Ro Full-text Url


  • https://ro.uow.edu.au/cgi/viewcontent.cgi?article=3935&context=eispapers1

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/2924

Start Page


  • 759-1

End Page


  • 759-14

Volume


  • 11

Issue


  • 6

Place Of Publication


  • Switzerland