AI Meets Beauty

Perfect Half Million Beauty Product Image Recognition Challenge

As the revolution of artificial intelligence (AI) is underway around the globe, AI has already begun to reshape industries including the multibillion dollar beauty and personal care industry. In order to promote impactful research and problem solving in this disruptive AI beauty space, the leading beauty app developer, Perfect Corp. in collaborating with CyberLink Corp. and Academia Sinica to provide a large-scale image dataset of over half million images of beauty and personal care products, namely the Perfect-500K dataset. Perfect-500K is vast in scale, rich and diverse in content in order to collect as many as possible beauty and personal care items from major e-commerce sites.

*Reaching 580 million app downloads for its YouCam Apps suite, installs worldwide as of March 2018

AI Meets Beauty

Perfect Half Million Beauty Product Image Recognition Challenge

As the revolution of artificial intelligence (AI) is underway around the globe, AI has already begun to reshape industries including the multibillion dollar beauty and personal care industry. In order to promote impactful research and problem solving in this disruptive AI beauty space, the leading beauty app developer, Perfect Corp. in collaborating with CyberLink Corp. and Academia Sinica to provide a large-scale image dataset of over half million images of beauty and personal care products, namely the Perfect-500K dataset. Perfect-500K is vast in scale, rich and diverse in content in order to collect as many as possible beauty and personal care items from major e-commerce sites.

*Reaching 580 million app downloads for its YouCam Apps suite, installs worldwide as of March 2018

Participation

The Challenge is a team-based competition. Each team can have one or more members, and each individual can only be part of one team.
The Perfect Challenge 2018 is open to the public. Interested individuals, researchers/developers of tertiary education, research institutes or organizations from different sectors and fields are welcome to take part independently or as a team.

Disclaimer: The organizers reserve the right to disqualify participants if the information provided on the application is inaccurate or misleading. The dataset provided by the organizer can only be used for this challenge and its related research activities. Commercial use is strictly prohibited.

At the end of the Challenge, all teams will be ranked based on both objective evaluation and subjective human evaluation criteria described above. The top three performing teams will receive award certificates and cash prizes:

At the same time, all accepted submissions are qualified for the conference’s grand challenge award competition. Please note that each winning team for the cash prizes is required to open source their proposed solution on Github before qualifying to receive the cash prizes.



Timeline

Unless otherwise stated, all deadlines are at 23:59 Anywhere on Earth (AoE), UTC-12.
please follow the instructions on the main conference website







Citation

If you are reporting results of the challenge or using the dataset, please cite with:

					  	@misc{perfecthalfmillionchallenge2018,title={Perfect Corp. Challenge 2018: 
Half Million Beauty Product Image Recognition,author={Wen-Huang Cheng,
Jia Jia, Si Liu, Jianlong Fu, Johnny Tseng, and Jau Huang,howpublished=
{\url{https://challenge2018.perfectcorp.com/index.html},year={2018}}





Paper Submission

Please follow the guideline of ACM Multimedia 2018 Grand Challenge for the paper submission.




Main Organizers

  • Jau Huang

    Jau Huang

    CyberLink Corp.

  • Johnny Tseng

    Johnny Tseng

    Perfect Corp.

  • Wen-Huang Cheng

    Wen-Huang Cheng

    Academia Sinica

  • Jia Jia

    Jia Jia

    Tsinghua University

  • Si Liu

    Si Liu

    Chinese Academy of Sciences

  • Jianlong Fu

    Jianlong Fu

    Microsoft Research

Sponsors


PerfectCorp is dedicated to transforming how consumers, content creators and beauty brands interact together. Our unique platform is the premier online destination for all beauty lovers. Our PERFECTTM apps, YouCam Makeup, recently voted Best Fashion & Apparels App* of 2015, and market leading YouCam Perfect redefine virtual beauty for tens of millions of users.
*YouCam Makeup is the winner of 2015 Appy Award of Best Fashion & Apparels App


Founded in 1996, CyberLink Corp. is the world’s leading multimedia software company and pioneer in video and audio technologies on PCs and portable devices including tablets and smartphones. From what began as a mission to create superb digital multimedia products for consumers by a group of National Taiwan University students led by Professor Huang, CyberLink has since grown into a global and award-winning brand with nearly 30 products and a solid reputation for efficiently delivering innovative, interoperable solutions.

Task Chairs & Main Contact

Dataset

Perfect-500K is a collection of beauty and personal care items from 14 popular e-commerce sites, including Amazon (USA, India), Cult Beauty, Flipkart, Galleria, Gmarket, JD.COM, Nordstrom, Sephora, Strawberrynet, Target, Walgreens, Walmart and Yahoo Shopping Mall. The table below shows the detailed statistics.

Source # of images
Amazon (USA) 129192
Amazon (India) 208936
Cult Beauty 3139
Flipkart 38726
Yahoo Shopping Mall 22407
Target 11896
JD.COM 5084
Sephora 7099
Strawberrynet 16040
Walgreens 7273
Walmart 34428
Gmarket 19579
Nordstrom 8786
Galleria 8142
TOTAL 520727

Download Link

Note that the datasets will ONLY be released to participants who have registered for the challenge during the competition period. After the challenge is completed, we will make the data publically available to the whole research community.

Task Description

This year we will focus on one particular task: beauty and personal care product recognition. Meanwhile, we are open for innovative self-proposed topics.


Main Task: Beauty and personal care product recognition

Given a real-world image containing one beauty or personal care item (some samples are given below), the task is to match the real-world example of this item to the same item in the Perfect-500K data set. This is a practical but extremely challenging task, given the limitation that only images from e-commerce sites are available in Perfect-500K and no real-world examples will be provided in advance.

sample
sample
sample
sample
sample

Submission Format & Evaluation Metrics

Each team is allowed to submit the results of at most five runs, selecting one run as the primary run of the submission (we do not guarantee that we will evaluate additional runs), which will be measured for performance comparison across teams. Each submission is required to be formatted as a csv file, where each line contains an image id followed by seven predicted labels sorted by confidence in descending order. It looks as follows:

<Test Image ID id#1>, <Training Image ID id#1_1>, <Training Image ID id#1_2>, ..., <Training Image ID id#1_6>, <Training Image ID id#1_7>
<Test Image ID id#2>, <Training Image ID id#2_1>, <Training Image ID id#2_2>, ..., <Training Image ID id#2_6>, <Training Image ID id#2_7>
…
<Test Image ID id#N>, <Training Image ID id#N_1>, <Training Image ID id#N_2>, ..., <Training Image ID id#N_6>, <Training Image ID id#N_7>

For each test image, the evaluation metric is Mean Average Precision@7 (MAP@7). The performance of each individual test image is then averaged to evaluate the submissions to this challenge.

Leader Board



Rank Team Name Score(mAP)
1 VCA 0.577567
2 GAN 0.29135
3 WISLAB 0.270676
4 CISIP 0.251895
5 ivlab2017 0.229133
6 ML Artists 0.214105
7 Team ViPr 0.205836
8 USTC_316 0.185988
9 vyzuer 0.152462
10 Toan Vu 0.143374
11 DLUT-CC 0.115426
12 CAPG-MM 0.099769
13 Researchers 0.046169
Copyright © Perfect Corp. 2018