inspect media
Look at media, or ask a model about it: a library item, or a picture or video at a web address (urls) read without keeping it. An image returns the picture with its size in pixels. A video returns frames: overview (one storyboard grid, frames spread evenly over the file, default), window (a grid of one span), frame (one moment), strip (one span as frames with the waveform and words under them), or shot_log (every segment in order with its span, frame, spoken lines and a written line each; cloud only, one video). A file with a transcript returns spoken, unasked: the sentences in the span, the opening lines for a whole file (transcribe_media reads the rest). cuts: true adds every shot change and shot length once the video is indexed. Audio returns spoken alone. prompt, on one video or audio file, has a model watch or listen and answer the question, with the moments the answer rests on as seconds; a long read returns a job; cloud only, not for images. Up to 12 refs or urls a call, in order, each item naming its pictures by position. Cached. inspect_timeline reads the composite. Free to look; cuts on an unindexed video, shot_log and prompt use cloud processing.
Authorizations
An API key (es_live_…) from Settings, under API keys, or an OAuth access token.
Headers
Retry a paid dispatch safely: the same key returns the job already dispatched instead of charging again.
The workspace this one call acts in, when it is not the default: for a key or a connected agent, one of the workspaces the user allowed it.
Body
A library item ref. One of ref, refs or urls.
Up to 12 library item refs, each read with the same mode, window and at. One that cannot be read comes back as { ref, error } beside the rest.
1 - 12 elementsUp to 12 web addresses of pictures or videos, read without keeping them. The same modes as refs; twelve in all with refs. One that cannot be read comes back as { url, error }.
1 - 12 elementsVideo only. overview = whole-video storyboard grid (default); window = zoom into a span; frame = one exact moment; strip = one span (up to 60 s) as frames, waveform and words in one picture.
overview, window, frame, strip, shot_log window and strip modes: {start, end} in seconds.
frame mode: timestamp in seconds.
x >= 0overview and window: how many frames the grid holds (default 36 up to a minute, else 12 or 16). Fewer draws each larger.
1 <= x <= 36An image or a single video frame (frame mode) comes back ruled in tenths, 0 to 1 each way, so a point read off it is the x and y that edit_points on generate_image and generate_video take.
Video only: every shot change and shot length. Free once the video is indexed; otherwise the file is read through on cloud processing.
A question for a model to answer about one video or audio file: motion, sound, timing, how type enters, when a thing happens. Answered in the call, moments as seconds, or past about 20 seconds as a job_id for get_jobs; no answer, no charge. One ref or url.
1 - 4000
