The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results of various sensors for the fusion of the detection layer.This paper proposes a multi-scale and multi-sensor data fusion strategy in the front end of perception and accomplishes a multi-sensor function disparity map generation scheme.A binocular stereo vision sensor composed of two cameras and a light deterction and ranging(LiDAR)sensor is used to jointly perceive the environment,and a multi-scale fusion scheme is employed to improve the accuracy of the disparity map.This solution not only has the advantages of dense perception of binocular stereo vision sensors but also considers the perception accuracy of LiDAR sensors.Experiments demonstrate that the multi-scale multi-sensor scheme proposed in this paper significantly improves disparity map estimation.
SUN GuoliangPEI ShanshanLONG QianZHENG SifaYANG Rui
Field environmental sensing can acquire real-time environmental information,which will be applied to field operation,through the fusion of multiple sensors.Multi-sensor fusion refers to the fusion of information obtained from multiple sensors using more advanced data processing methods.The main objective of applying this technology in field environment perception is to acquire real-time environmental information,making agricultural mechanical devices operate better in complex farmland environment with stronger sensing ability and operational accuracy.In this paper,the characteristics of sensors are studied to clarify the advantages and existing problems of each type of sensors and point out that multiple sensors can be introduced to compensate for the information loss.Secondly,the mainstream information fusion types at present are outlined.The characteristics,advantages and disadvantages of different fusion methods are analyzed.The important studies and applications related to multi-sensor information fusion technology published at home and abroad are listed.Eventually,the existing problems in the field environment sensing at present are summarized and the prospect for future of sensors precise sensing,multi-dimensional fusion strategies,discrepancies in sensor fusion and agricultural information processing are proposed in hope of providing reference for the deeper development of smart agriculture.
Multi-modal image matching is crucial in aerospace applications because it can fully exploit the complementary and valuable information contained in the amount and diversity of remote sensing images.However,it remains a challenging task due to significant non-linear radiometric,geometric differences,and noise across different sensors.To improve the performance of heterologous image matching,this paper proposes a normalized self-similarity region descriptor to extract consistent structural information.We first construct the pointwise self-similarity region descriptor based on the Euclidean distance between adjacent image blocks to reflect the structural properties of multi-modal images.Then,a linear normalization approach is used to form Modality Independent Region Descriptor(MIRD),which can effectively distinguish structural features such as points,lines,corners,and flat between multi-modal images.To further improve the matching accuracy,the included angle cosine similarity metric is adopted to exploit the directional vector information of multi-dimensional feature descriptors.The experimental results show that the proposed MIRD has better matching accuracy and robustness for various multi-modal image matching than the state-of-the-art methods.MIRD can effectively extract consistent geometric structure features and suppress the influence of SAR speckle noise using non-local neighboring image blocks operation,effectively applied to various multi-modal image matching.
The advent of remote livestock monitoring systems provides numerous possibilities for improving on-farm productivity,efficiency,and welfare.One potential application for these systems is for the detection of calving events.This study describes the integration of data from multiple sensor sources,including accelerometers,global navigation satellite systems(GNsS),an accelerometer-derived rumination algorithm,a walk-over-weigh unit,and a weather station for parturition detection using a support vector machine approach.The best performing model utilised data from GNsS,the ruminating algorithm,and weather stations to achieve 98.6%accuracy,with 88.5%sensitivity and 100%specificity.The topranking features of this model were primarily GNSS derived.This study provides an overview as to how various sensor systems could be integrated on-farm to maximise calving detection for improved production and welfare outcomes.
