Microsoft Patent | Privacy Image Generation

Patent: Privacy Image Generation

Publication Number: 20180365809

Publication Date: 2018-12-20

Applicants: Microsoft

Abstract

A privacy image generation system may use a light field camera that includes an array of cameras or an RGBZ camera(s)) is used to capture images and display images according to a selected privacy mode. The privacy mode may include a blur background mode that can be automatically selected based on the meeting type, participants, location, and device type. A region of interest and/or an object(s) of interest (e.g. one or more persons in a foreground) is determined and the privacy image generation system is configured to clearly show the region/object of interest and obscure or replace the background by combining multiple images. The displayed image includes the region/object(s) of interest clearly shown (e.g. in focus) and any objects in a background of the combined image shown having a limited depth of field (e.g. blurry/not in focus) and/or blurred due to the combination of the multiple images.

Background

Video conferencing is becoming more popular both at home and at work. Many users, however, may not wish to have their background in a shared work or home environment clearly visible to other participants. For example, the background may be messy, distracting, and/or include confidential information, and the like. While some video conferencing systems may use a background replacement (e.g. green screen/static background) or include a blurring capability, these methods may be difficult to implement (e.g., require a green screen) or may adversely impact a display of content in a scene (e.g., have significant image artifacts).

Summary

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

A privacy image generation system may obtain multiple images, for example from a light field camera that includes an array of cameras or an RGBZ (RGB+ depth) camera(s)) is used to capture images and display images according to a selected privacy mode. The privacy mode may include a blur background mode and a background replacement mode. A region of interest and/or an object(s) of interest (e.g. one or more persons in a foreground) is determined and the privacy image generation system is configured (e.g. depending on the type of camera) to clearly show the region/object of interest and the background according to the selected privacy mode. The displayed image includes the region/object(s) of interest clearly shown (e.g. in focus) and any objects in a background of the combined image shown having a limited depth of field (e.g. blurry/not in focus) and/or the background replaced with another image and/or fill. The privacy image generation system may also be used to determine a depth estimate for object in a scene.