Scene Detection

What is Scene Detection?

Scene detection is a technique used in video processing to identify and separate different scenes within a video. This is particularly useful for tasks such as video summarization, content analysis, and ad insertion. The path to use scene detection:

core/scene-detection

Running Scene Detection

To run scene detection:

resp = moonshine.run(
  flow="core/scene-detection",
  index="your-index",
  video_id="[file_id].mp4"
)

Scene detection can only be run on one video at a time. If you need to process multiple videos, you will need to run the scene detection function for each video separately.

Scene Detection Response Format

The response of scene detection follows:

output
status
video_id

object

JSON object (returned as a string) that contains the [output][scenes]

List[object]

List of scene objects detected in the video

Where a scene item is made out of:

integer

Sequential identifier for the scene

Example:

{
  "output": {
    "scenes": [
      {
        "scene_id": 1,
        "start_time": "00:00:00",
        "end_time": "00:01:25",
        "description": "The initial segment of a basketball game at the Intuit Dome, featuring early plays, dunks, and three-pointers with ongoing commentary.",
        "type": "action-oriented",
        "cues": "Close-ups, wide court shots, score progression, live commentary",
        "characters_or_subjects": "Sohan, Wembanyama, Harden, Champagne, other players"
      }
    ]
  },
  "status": "complete",
  "video_id": "[file_id].mp4"
}

Scene Detection Complete Example

A complete example over an entire index:

import moonshine

moonshine.configure("YOUR-TOKEN-HERE")
index = "my-videos"

items = moonshine.items(index=index)
for item in items:
    file_id = item["file_id"]
    file_name = item["file_name"]
    print(f"Processing video: {file_name} (ID: {file_id})")

    resp = moonshine.run(
        flow="core/scene-detection",
        index=index,
        video_id=file_id
    )

    print(f"Scene detection results for {file_name}: {resp}")

Scene Detection JSON

Workflows are in a private beta. Please contact us at team@usemoonshine.com to request access.

.run(flow='core/scene-detection', ...) params

string

required

Name/ID of the parent index of the video being processed.

string

required

ID of the video being processed.

Get Started

Ingestion

Running Functions

Workflows

What is Scene Detection?

Running Scene Detection

Scene Detection Response Format

Scene Detection Complete Example

Scene Detection JSON

​What is Scene Detection?

​Running Scene Detection

​Scene Detection Response Format

​Scene Detection Complete Example

​Scene Detection JSON

What is Scene Detection?

Running Scene Detection

Scene Detection Response Format

Scene Detection Complete Example

Scene Detection JSON