Adaptive and Integared PV Output control with Battery Energy Storage

/in /by

An adaptive control system for battery integrated PV generation is designed to reduce the fluctuating in PV power production. The core component of the system is a four-layer power control system (PCS) for Battery Energy Storage (BES). BES responds to the power dispatch commands from PCS and charges/discharges to mitigate variations in PV power output. As a core part of the system, a novel PV power smoothing algorithm is proposed to reduce battery capacity requirements and reduce battery life losses by adaptively adjusting control parameter settings based on real-time system characteristics. Extensive simulation results based on real PV generation data have been presented to justify the effectiveness of the proposed approach and to show how several key parameters affect its performance.

Read more

Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection

/in /by

Unsupervised anomaly detection on multi- or high-dimensional data is of great importance in both fundamental machine learning research and industrial applications, for which density estimation lies at the core. Although previous approaches based on dimensionality reduction followed by density estimation have made fruitful progress, they mainly suffer from decoupled model learning with inconsistent optimization goals and incapability of preserving essential information in the low-dimensional space. In this paper, we present a Deep Autoencoding Gaussian Mixture Model (DAGMM) for unsupervised anomaly detection. Our model utilizes a deep autoencoder to generate a low-dimensional representation and reconstruction error for each input data point, which is further fed into a Gaussian Mixture Model (GMM). Instead of using decoupled two-stage training and the standard Expectation-Maximization (EM) algorithm, DAGMM jointly optimizes the parameters of the deep autoencoder and the mixture model simultaneously in an end-to-end fashion, leveraging a separate estimation network to facilitate the parameter learning of the mixture model. The joint optimization, which well balances autoencoding reconstruction, density estimation of latent representation, and regularization, helps the autoencoder escape from less attractive local optima and further reduce reconstruction errors, avoiding the need of pre-training. Experimental results on several public benchmark datasets show that, DAGMM significantly outperforms state-of-the-art anomaly detection techniques, and achieves up to 14% improvement based on the standard F1 score.

Read more

Co-Regularized Deep Multi-Network Embedding

/in /by

Network embedding aims to learn a low-dimensional vector representation for each node in the social and information networks, with the constraint to preserve network structures. Most existing methods focus on single network embedding, ignoring the relationship between multiple networks. In many real-world applications, however, multiple networks may contain complementary information, which can lead to further refined node embeddings. Thus, in this paper, we propose a novel multi-network embedding method, DMNE. DMNE is flexible. It allows different networks to have different sizes, to be (un)weighted and (un)directed. It leverages multiple networks via cross-network relationships between nodes in different networks, which may form many-to-many node mappings, and be associated with weights. To model the non-linearity of the network data, we develop DMNE to have a new deep learning architecture, which coordinates multiple neural networks (one for each input network data) with a co-regularized loss function. With multiple layers of non-linear mappings, DMNE progressively transforms each input network to a highly non-linear latent space, and in the meantime, adapts different spaces to each other through a co-regularized learning schema. Extensive experimental results on real-life datasets demonstrate the effectiveness of our method.

Read more

Optimal Sizing and Operation of Energy Storage for Demand Charge Management and PV Utilization

/in /by

This paper presents a method to determine optimal energy and power capacity of distributed Energy Storage Systems (ESS) in behind-the-meter applications to maximize local Photovoltaic (PV) utilization or minimize Demand Charge (DC) cost. The problem is solved as a multi-objective optimization model to obtain a set of Pareto optimal solutions for each scenario in each month. An approach is then presented to map the monthly Pareto fronts into a single yearly Pareto front. A cost benefit analysis has also been carried out to show the compromise between PV utilization, DC cost, and ESS cost.

Read more

Memory Warps for Learning Long-Term Online Video Representations

/in /by

This paper proposes a novel memory-based online video representation that is efficient, accurate and predictive. This is in contrast to prior works that often rely on computationally heavy 3D convolutions, ignore actual motion when aligning features over time, or operate in an off-line mode to utilize future frames. In particular, our memory (i) holds the feature representation, (ii) is spatially warped over time to compensate for observer and scene motions, (iii) can carry long-term information, and (iv) enables predicting feature representations in future frames. By exploring a variant that operates at multiple temporal scales, we efficiently learn across even longer time horizons. We apply our online framework to object detection in videos, obtaining a large 2.3 times speed-up and losing only 0.9% mAP on ImageNet-VID dataset, compared to prior works that even use future frames. Finally, we demonstrate the predictive property of our representation in two novel detection setups, where features are propagated over time to (i) significantly enhance a real-time detector by more than 10% mAP in a multi-threaded online setup and to (ii) anticipate objects in future frames.

Read more

Feature Transfer Learning for Deep Face Recognition with Long-Tail Data

/in /by

Real-world face recognition datasets exhibit long-tail characteristics, which results in biased classifiers in conventionally-trained deep neural networks, or insufficient data when long-tail classes are ignored. In this paper, we propose to handle long-tail classes in the training of a face recognition engine by augmenting their feature space under a center-based feature transfer framework. A Gaussian prior is assumed across all the head (regular) classes and the variance from regular classes are transferred to the long-tail class representation. This encourages the long-tail distribution to be closer to the regular distribution, while enriching and balancing the limited training data. Further, an alternating training regimen is proposed to simultaneously achieve less biased decision boundaries and a more discriminative feature representation. We conduct empirical studies that mimic long-tail datasets by limiting the number of samples and the proportion of long-tail classes on the MS-Celeb-1M dataset. We compare our method with baselines not designed to handle long-tail classes and also with state-of-the-art methods on face recognition benchmarks. State-of-the-art results on LFW, IJB-A and MS-Celeb-1M datasets demonstrate the effectiveness of our feature transfer approach and training strategy. Finally, our feature transfer allows smooth visual interpolation, which demonstrates disentanglement to preserve identity of a class while augmenting its feature space with non-identity variations.

Read more

Channel-Recurrent Autoencoding for Image Modeling

/in /by

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types (Figure 1), potentially due to the oversimplification of their latent space constructions. To tackle this issue, building on Variational Autoencoders (VAEs), we integrate recurrent connections across channels to both inference and generation steps, allowing the high-level features to be captured in global-to-local, coarse-to-fine manners. Combined with adversarial loss, our channel-recurrent VAE-GAN (crVAE-GAN) outperforms VAE-GAN in generating a diverse spectrum of high resolution images while maintaining the same level of computational efficacy. Our model produces interpretable and expressive latent representations to benefit downstream tasks such as image completion. Moreover, we propose two novel regularizations, namely the KL objective weighting scheme over time steps and mutual information maximization between transformed latent variables and the outputs, to enhance the training.

Read more

Universal Hybrid Probabilistic-geometric Shaping Based on Two-dimensional Distribution Matchers

/in /by

We propose universal distribution matchers applicable to any two-dimensional signal constellation. We experimentally demonstrate that the performance of 32-ary QAM, based on hybrid probabilistic-geometric shaping, is superior to probabilistically shaped 32QAM and regular 32QAM.

Read more

Flex-Rate Transmission using Hybrid Probabilistic and Geometric Shaped 32QAM

/in /by

A novel algorithm to design geometric shaped 32QAM to work with probabilistic shaping is proposed to approach the Shannon limit within ~0.2 dB in SNR. The experimental results show ~0.2 dB SNR advantage over 64Gbaud PAS-64QAM, and flex-rate transmission demonstrates > 500 km reach improvement over 32QAM.

Read more

Evolution from 8QAM live traffic to PCS 64-QAM with Neural-Network Based Nonlinearity Compensation on 11000 km Open Subsea Cable

/in /by

We report on the evolution of the longest segment of FASTER cable at 11,017 km, with 8QAM transponders at 4b/s/Hz spectral efficiency (SE) in service. With offline testing, 6 b/s/Hz is further demonstrated using probabilistically shaped 64QAM, and a novel, low complexity nonlinearity compensation technique based on generating a black-box model of the transmission by training an artificial neural network, resulting in the largest SE-distance product 66,102 b/s/Hz-km over live-traffic carrying cable.

Read more