Context Schema

Context sources

• TV Archive (did any portion of a clip appear in archived broadcast TV) (example)
  • Network / Station
  • Air time
  • Key words from the program
  • Facial recognition data (available for cable news, some faces)
  • Start time / stop time
  • Transcript (SRT)
  • Program topics
  • Up to 3 minutes of video around the moment (Could be used to extract more information)
• Derivable information
  • NLP on transcript (topic / claim detection)
  • Face detection (not recognition per se) from the videos
  • Moments of intensity / high vocal pitch from the audio
• Fact Check API
  • Related fact checks to transcript?

Initial Schema

Should we use the MediaObject and Clips schema.org thing? Or should we just come up with our own...

"Aspirational" Schema

This has more data than we care about or need.

    {
        mediaObject: ((http://schema.org/MediaObject)),
        transcript: ""
        hyperTranscript: [],
        transcludes: [
            {
                airtime: 0,
                start: 0,
                end: 0,
                mediaObject: ((http://schema.org/MediaObject)),
                broadcast: {
                    airtime: 0,
                    network: ((http://schema.org/Organization)),
                    station: ((http://schema.org/Organization)),
                    programName: '',
                    description: '',
                    advertisers: [
                        ((http://schema.org/Organization)),
                    ],
                    hosts: [
                        ((http://schema.org/Person)),
                    ],
                    guests: [
                        ((http://schema.org/Person)),
                    ],
                },
                before: {
                    duration: 0,
                    mediaObject: ((http://schema.org/MediaObject)),
                    transcript: '',
                    hyperTranscript: [],
                }
                after: {
                    duration: 0,
                    mediaObject: ((http://schema.org/MediaObject)),
                    transcript: '',
                    hyperTranscript: [],
                }
            },
        ],
        websites: [
            ((http://schema.org/WebSite)),
        ],
        interactions: [
            ((http://schema.org/InteractAction))
        ],
        clips: [
            {
                start: 0,
                end: 0, 
                metadata: {
                    faces: [
                        {
                            location: {
                                left: 0,
                                top: 0,
                                height: 0,
                                width: 0,
                            },
                            rotation: 0,
                            person: ((http://schema.org/Person)),
                            emotion: "",
                        },
                    ],
                    things: [
                        {
                            location: {
                                left: 0,
                                top: 0,
                                height: 0,
                                width: 0,
                            },
                            object: http://schema.org/Thing
                        }
                    ],
                    text: [
                        {
                            location: {
                                left: 0,
                                top: 0,
                                height: 0,
                                width: 0,
                            },
                            content: ""
                        },
                    ],
                    graphics: [
                        {
                            location: {
                                left: 0,
                                top: 0,
                                height: 0,
                                width: 0,
                            },
                            type: ""
                        }
                    ]
                }
            }
        ]
    }

Here is an example "dummy data" for our initial version:

{
    "mediaObject": {
        "@context": "http://schema.org",
        "@type": "VideoObject",
        "contentUrl": "https://archive.org/details/TrumpTape",
        "description": "Donald Trump talking to Billy Bush about how he sexually harasses women.",
        "duration": 140,
        "encodingFormat": "mp4",
        "name": "trumptape.mp4"
    },
    "transcript": "INSERT TRANSCRIPT HERE.""
    "transcludes": [
        {
            "clipStart": 0,
            "transcludeStart": 0,
            "duration": 0,
            "mediaObject": {
                "@context": "http://schema.org",
                "@type": "VideoObject",
                "contentUrl": "https://archive.org/details/TrumpTape",
                "description": "Donald Trump talking to Billy Bush about how he sexually harasses women.",
                "duration": 140,
                "encodingFormat": "mp4",
                "name": "trumptape.mp4"
            },
            "broadcast": {
                "airtime": 0,
                },
                "station": {
                    "@context":"http://schema.org",
                    "@type":"BroadcastService",
                    "name":"WAAY-TV",
                    "broadcastDisplayName":"ABC",
                    "broadcastTimezone": "-8:00",
                    "broadcastAffiliateOf":{
                        "@type":"Organization",
                        "name":"ABC"
                    }
                },
                "programName": ",
                "description": ",
            },
            before: {
                "duration": 0,
                "mediaObject": {
                    "@context": "http://schema.org",
                    "@type": "VideoObject",
                    "contentUrl": "https://archive.org/details/TrumpTape",
                    "description": "Donald Trump talking to Billy Bush about how he sexually harasses women.",
                    "duration": 140,
                    "encodingFormat": "mp4",
                    "name": "trumptape.mp4"
                },
                "transcript": "",
            }
            after: {
                duration: 0,
                mediaObject: {
                    "@context": "http://schema.org",
                    "@type": "VideoObject",
                    "contentUrl": "https://archive.org/details/TrumpTape",
                    "description": "Donald Trump talking to Billy Bush about how he sexually harasses women.",
                    "duration": 140,
                    "encodingFormat": "mp4",
                    "name": "trumptape.mp4"
                },
                transcript: '',
            }
        },
    ],
}