July 8, 2019

Microsoft Seeing AI API v1

This API was reverse engineered from the Microsoft Seeing AI app available for iOS, version 3.0.0.0.

Table of Contents:

Load-balanced endpoint

https://seeingai.trafficmanager.net

Get product name from barcode digits

POST /api/v1/query?intent=Product

Required headers:

Example request:

{ "barcode": "07895502" }

Example response:

{
   "Product":{
      "Content":"Diet Dr Pepper Cherry",
      "Format":"Text",
      "Metadata":{
         "MoreInfo":"Amazingly Smooth Zero calories. Zero calories Amazingly Smooth One 6-pack of 12 fluid ounce cans"
      },
      "Success":true
   }
}

Get text content from document photo

POST /api/v1/query?intent=Document

Required headers:

Example request:

[JPEG image bytes]

Example response:

{
  "Document": {
    "Content": "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"yes\"?>\r\n<html xmlns=\"http://www.w3.org/XML/XMLSchema/v1.1\">\r\n  <head>\r\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\r\n<style type=\"text/css\">body{font-family: arial; font-size: 12pt}</style></head>\r\n<body>\r\n<p style=\"font-size:54px;margin-top:0px;margin-bottom:2px;line-height:56px;text-indent:2px;text-align:justify\">IMPORTANT INFORMATION: This product subject to terms &amp; conditions (including an arbitration agreement); if you open the package, ...</p>\r\n\r\n</body>\r\n</html>",
    "Format": "HTML",
    "Success": true
  }
}

Get facial attributes from image of face(s)

POST /api/v1/query?intent=Person

Required headers:

Example request:

[JPEG image bytes]

Example response:

{
  "Person": {
    "Content": "34 year old man with Brown hair wearing glasses looking happy.",
    "Format": "Text",
    "Regions": [
      {
        "Height": 335,
        "Properties": {
          "age": "34",
          "emotion": "happy",
          "gender": "male",
          "glasses": "glasses",
          "hairColor": "Brown",
          "label": "34 year old man with Brown hair wearing glasses looking happy."
        },
        "Width": 335,
        "X": 15,
        "Y": 197
      }
    ],
    "Success": true
  }
}