Apple’s AI-Powered Image Playground App Reportedly Has Bias Issues

Apple’s Image Playground app is claimed to have some bias points. A machine studying scientist just lately shared a number of outputs generated utilizing the unreal intelligence (AI) app and claimed that it contained incorrect pores and skin tone and hair texture on a number of events. These inaccuracies have been additionally mentioned to be paired with particular racial stereotypes, including to the issue. It is tough to state whether or not the alleged subject is a one-off incident or a widespread subject. Notably, the Cupertino-based tech big first launched the app as part of Apple Intelligence swimsuit with the iOS 18.2 replace.

Apple’s Image Playground App Might Have Bias Issues

Jochem Gietema, the Machine Learning Science Lead at Onfido, shared a blog post, highlighting his experiences utilizing Apple’s Image Playground app. In the put up, he shared a number of units of outputs generated utilizing the Image Playground app and highlighted the situations of racial biases by the massive language mannequin powering the app. Notably, Gadgets 360 workers members didn’t discover any such biases whereas testing out the app.

“While experimenting, I seen that the app altered my pores and skin tone and hair relying on the immediate. Professions like funding banker vs. farmer produce photographs with very completely different pores and skin tones. The identical goes for snowboarding vs. basketball, streetwear vs. swimsuit, and, most problematically, prosperous vs. poor,” Gietema mentioned in a LinkedIn post.

Alleged biased outputs generated utilizing the Image Playground app
Photo Credit: Jochem Gietema

 

Such inaccuracies and biases usually are not uncommon with LLMs, that are skilled on massive datasets which could comprise related stereotypes. Last yr, Google’s Gemini AI mannequin confronted backlash for related biases. However, corporations usually are not fully helpless to forestall such generations and infrequently implement numerous layers of safety to forestall them.

Apple’s Image Playground app additionally comes with sure restrictions to forestall points related to AI-generated photographs. For occasion, the Apple Intelligence app solely helps cartoon and illustration kinds to keep away from situations of deepfakes. Additionally, the generated photographs are additionally generated with a slender visual view which normally solely captures the face together with a small quantity of extra particulars. This can also be carried out to restrict any such situations of biases and inaccuracies.

The tech big additionally doesn’t permit any prompts that comprise damaging phrases, names of celebrities or public figures, and extra to restrict customers abusing the instrument for unintended use instances. However, if the allegations are true, the iPhone maker might want to embody extra layers of security to make sure customers don’t really feel discriminated towards whereas utilizing the app.