Provable Membership Inference Privacy
Publication Date: 4/9/2024
Event: Transactions on Machine Learning Research
Reference: pp. 1-23, 2024
Authors: Zachary Izzo, NEC Laboratories America, Inc.; Jinsung Yoon, Google Cloud AI Research; Sercan Arik, Google Cloud AI Research; James Zou, Stanford University
Abstract: In applications involving sensitive data, such as finance and healthcare, the necessity for preserving data privacy can be a significant barrier to machine learning model development. Differential privacy (DP) has emerged as one canonical standard for provable privacy. However, DPs strong theoretical guarantees often come at the cost of a large drop in its utility for machine learning; and DP guarantees themselves are difficult to interpret. In this work, we propose a novel privacy notion, membership inference privacy (MIP), as a step towards addressing these challenges. We give a precise characterization of the relationship between MIP and DP, and show that in some cases, MIP can be achieved using less amount of randomness compared to the amount required for guaranteeing DP, leading to smaller drop in utility. MIP guarantees are also easily interpretable in terms of the success rate of membership inference attacks in a simple random sub-sampling setting. As a proof of concept, we also provide a simple algorithm for guaranteeing MIP without needing to guarantee DP.
Publication Link: https://openreview.net/forum?id=3ludyxPbb6
