DataXe: A System for Application Self-optimization in Serverless Edge Computing Environments

/in /by

A key barrier to building performant, remotely managed and self-optimizing multi-sensor, distributed stream processing edge applications is high programming complexity. We recently proposed DataX [1], a novel platform that improves programmer productivity by enabling easy exchange, transformations, and fusion of data streams on virtualized edge computing infrastructure. This paper extends DataX to include (a) serverless computing that automatically scales stateful and stateless analytics units (AUs) on virtualized edge environments, (b) novel communication mechanisms that efficiently communicate data among analytics units, and (c) new techniques to promote automatic reuse and sharing of analytics processing across multiple applications in a lights out, serverless computing environment. Synthesizing these capabilities into a single platform has been substantially more transformative than any available stream processing system for the edge. We refer to this enhanced and efficient version of DataX as DataXe. To the best of our knowledge, this is the first serverless system for stream processing. For a real-world video analytics application, we observed that the performance of the DataXe implementation of the analytics application is about 3X faster than a standalone implementation of the analytics application with custom, handcrafted communication, multiprocessing and allocation of edge resources.

Read more

Multi-user Beam Alignment in Presence of Multi-path

/in /by

To overcome the high pathloss and the intense shadowing in millimeterwave (mmWave) communications, effective beamforming schemes are required which incorporate narrow beams with high beamforming gains. The mm Wave channel consists of a few spatial clusters each associated with an angle of departure (AoD). The narrow beams must be aligned with the channel AoDs to increase the beamforming gain. This is achieved through a procedure called beam alignment (BA). Most of the BA schemes in the literature consider channels with a single dominant path while in practice the channel has a few resolvable paths with different AoDs, hence, such BA schemes may not work correctly in the presence of multi-path or at the least do not exploit such multi path to achieve diversity or increase robustness. In this paper, we propose an efficient BA schemes in presence of multi-path. The proposed BA scheme transmits probing packets using a set of scanning beams and receives the feedback for all the scanning beams at the end of probing phase from each user. We formulate the BA scheme as minimizing the expected value of the average transmission beamwidth under different policies. The policy is defined as a function from the set of received feedback to the set of transmission beams (TB). In order to maximize the number of possible feedback sequences, we prove that the set of scanning beams (SB) has an special form, namely, Tulip Design. Consequently, we rewrite the minimization problem with a set of linear constraints and reduced number of variables which is solved by using an efficient greedy algorithm.

Read more

DAS over 1,007-km Hybrid Link with 10-Tb/s DP-16QAM Co-propagation using Frequency-Diverse Chirped Pulses (OFC)

/in /by

We report the first distributed acoustic sensing (DAS) results over>1,000 km on a field-lab hybrid link using chirped-pulses with correlation detection and 20× frequency-diversity, achieving a sensitivity of 100 pa/√Hz at 20-meters spatial resolution.

Read more

Distributed Acoustic Sensing for Datacenter Optical Interconnects using Self-Homodyne Coherent Detection

/in /by

We demonstrate distributed acoustic sensing (DAS) over a bidirectional datacenter link which uses self-homodyne coherent detection for the data signal. Frequency multiplexing allows sharing the optoelectronic hardware, and enables DAS as an auxiliary function.

Read more

Employing Fiber Sensing and On-Premise AI Solutions for Cable Safety Protection over Telecom Infrastructure

/in /by

We review the distributed-fiber-sensing field trial results over deployed telecom networks. With local AI processing, real-time detection, and localization of abnormal events with cable damage threat assessment are realized for cable self-protection.

Read more

Perimeter Intrusion Detection with Rayleigh Enhanced Fiber Using Telecom Cables as Sensing Backhaul

/in /by

We report field test results of facility perimeter intrusion detection with distributed-fiber-sensing technology and backscattering-enhanced-fiber by using deployed telecom fiber cables as sensing backhaul. Various intrusive activities, such as walking/jumping at >100ft distance, are detected.

Read more

Remote Drone Detection and Localization with Optical Fiber Microphones and Distributed Acoustic Sensing

/in /by

We demonstrate the first fiber-optic drone detection method with ultra-highly sensitive optical microphones and distributed acoustic sensor. Accurate drone localization has been achieved through acoustic field mapping and data fusion.

Read more

Detection of Road Anomaly Using Distributed Fiber Optic Sensing

/in /by

Road surface condition can significantly impact the interaction between vehicles and pavement structure, which may even cause high fuel consumption and safety issues of drivers and vehicles. Distributed fiber optic sensing (DFOS) technology is a useful tool to perform continuous and real-time monitoring of traffic and road surface condition. However, it is challenging to process the data for the purpose of road anomaly detection. The study proposed two approaches to detect the road anomaly using DFOS. In the first method, local binary pattern (LBP) histograms were used to extract the features of the images with and without road anomaly, and support vector machine (SVM) combined with principal component analysis (PCA) was adopted as the classifier. The convolutional neural network (CNN) was applied on the binary classification data to analyze the images in the second method. The accuracy and benefits of two methodologies were compared. The vehicle speed was estimated by detecting lines using Hough transform. The feasibility of road anomaly detection using DFOS is proved.

Read more

Vibration Detection and Localization using Modified Digital Coherent Telecom Transponders

/in /by

We demonstrate a vibration detection and localization scheme based on bidirectional transmission of telecom signals with digital coherent detection at the receivers. Optical phase is extracted from the digital signal processing blocks of the coherent receiver, from which the vibration component is extracted by bandpass filtering, and the position along the cable closest to the vibration’s epicenter is recovered by correlation. We demonstrate our scheme first using offline experiment with 200-Gb/s DP-16QAM, and we report field trial results over installed fiber to detect real-world vibration events.

Read more

Weight Pruning Techniques for Nonlinear Impairment Compensation using Neural Networks

/in /by

Neural networks (NNs) are attractive for nonlinear impairment compensation applications in communication systems, such as optical fiber nonlinearity, nonlinearity of driving amplifiers, and nonlinearity of semiconductor optical amplifiers. Without prior knowledge of the transmission link or the hardware characteristics, optimal parameters are completely constructed from a data-driven approach by exploring training datasets, once the NN structure is given. On the other hand, due to computational power and energy consumption, especially in high-speed communication systems, the computational complexity of the optimized NN needs to be confined to the hardware, such as FPGA or ASIC without sacrificing its performance improvement. In this paper, two approaches are presented to accommodate the NN-based algorithms for high-speed communication systems. The first approach is to reduce computational complexity of the NN-based nonlinearity compensation algorithms on the basis of weight pruning (WP). WP can significantly reduce the computational complexity, especially because the nonlinear compensation task studied here results in a sparse NN. The authors have studied an enhanced approach of WP by imposing an additional restriction on the selection of non-zero weights on each hidden layer. The second approach is to implement NNs onto a silicon-photonic integrated platform, enabling power efficiency to be further improved without sacrificing the high-speed operation.

Read more