视频眼神矫正

描述

本接口用于发起对口型投递任务的请求,投递成功后开始异步执行算法。用户可通过查询接口主动查询算法执行结果。

版本

1.0

图片要求

原文媒体文件要求:支持 wav、m4a、mp4、mp3、aac 等格式。原文未说明尺寸、文件大小或时长限制。

调用 URL

    正式环境:https://openapi.meitu.com
    任务提交接口:https://openapi.meitu.com/api/v1/sdk/sync/push
    任务名称(task):/v1/mtgazecorrect_v2_vid/481969
    任务类型(task_type):formula

调用方法

POST

Content-Type: application/json

权限

开放平台接口签名

请求参数

是否必选参数名类型参数说明
必选paramsstring算法参数(JSON 字符串)
必选init_imagesobject[]多媒体文件列表
必选taskstring固定 /v1/mtgazecorrect_v2_vid/481969
必选task_typestring固定 formula
可选sync_timeoutint默认 30,同步超时时间;超时后 status 返回 9,需使用查询接口获取结果

init_images 多媒体文件参数,结构说明如下

是否必选参数名类型参数说明
必选urlstring多媒体 URL 或 base64
必选profileobject属性信息描述

profile 属性信息描述

是否必选参数名类型参数说明
必选media_profilesobject媒体属性信息
必选versionstring固定 v1

media_profiles 媒体属性信息

是否必选参数名类型参数说明
必选media_data_typestringurl 表示 URL;jpg 等类型表示 base64

params 推理参数是 JSON 字符串,其结构说明如下

是否必选字段类型说明
可选rsp_media_typestring默认 urljpg 表示 base64
必选parameterobject算法核心参数对象

parameter 算法参数详情

原参数表将眼神矫正字段直接列在 parameter 下,原请求示例则将这些字段放在 parameter.base 下。以下按原请求示例的嵌套结构展示,同时保留原参数表给出的字段说明。

是否必选参数名类型参数说明
原文未说明baseobject眼神矫正参数对象;结构见下表
原文未说明extraobject扩展参数;原请求示例为空对象
原文未说明versionstring原请求示例值为 2.0.0

base 算法参数详情

是否必选参数名类型参数说明
close_threshfloat闭眼阈值,默认 0.2
vis_ratiofloat可见点比例,默认 0.49
vis_threshfloat可见点置信度,默认 0.91
enhance_ratiofloat增强系数,默认 1.0
distance_errorfloat眼球位置判断阈值,默认 0.024
原文未说明distance_error_y_plusfloat原请求示例值为 0.9;原文未说明含义、默认值和必选性
color_optbool局部色彩矫正,默认 true
enable_tunebool局部微调,默认 true
wink_optbool眨眼优化,默认 false
enable_enhancebool细节增强,默认 true

输入值示例

{
  "task": "/v1/mtgazecorrect_v2_vid/481969",
  "task_type": "formula",
  "init_images": [
    {
      "url": "https://obs.mtlab.meitu.com/public/EtRGxLI8ulQ43pGhuZfym9aYUD2PUbMP/MTc0OTc4MDAwMA==/0281e99d-c48a-497f-5812-6ef391e200e3.mp4",
      "profile": {
        "media_profiles": {
          "media_data_type": "url"
        },
        "version": "v1"
      }
    }
  ],
  "params": "{\"rsp_media_type\":\"url\",\"parameter\":{\"base\":{\"close_thresh\":0.2,\"color_opt\":true,\"distance_error\":0.024,\"distance_error_y_plus\":0.9,\"enable_enhance\":true,\"enable_tune\":true,\"enhance_ratio\":1.0,\"vis_ratio\":0.49,\"vis_thresh\":0.91,\"wink_opt\":false},\"extra\":{},\"version\":\"2.0.0\"}}",
  "sync_timeout": 30
}

返回值说明

注意,生成的结果,会定期清理,请及时下载保存
字段类型说明
request_idstring请求标识
trace_idstring链路追踪标识
codeint业务状态码,0 表示请求受理成功
error_codeint错误码,成功时为 0
messagestring业务信息
tipsany补充提示,可为 null
dataobject任务状态和算法结果

data 中单个元素的字段说明

字段类型说明
statusint状态码:-1 未找到任务;0 创建成功;1 执行中;2 失败;9 超时,使用查询接口查询;10 成功
resultobject算法结果
progressnumber任务进度(0–100),0 表示未开始或刚创建
predict_elapsedint预计耗时,毫秒
create_timeint64创建时间戳,毫秒
task_idstring任务 ID
custom_task_idstring客户自定义任务 ID
trace_idstringdata 内链路标识
client_infostring客户端信息
init_imagesobject[]/null输入媒体回显

result 中单个元素的字段说明

字段类型说明
idstring任务 ID;原字段表标为 int,原返回示例为 string
urlsstring[]结果媒体 URL 列表
parametersobject任务参数信息
dataobject任务结果信息;结构见下表
predict_elapsedint预测耗时,原文说明单位为秒
msgstring原字段表标为 long 并说明为任务创建时间戳(毫秒),原返回示例则为消息字符串
msg_idstring用于区分每次请求的唯一字符串
imagesstring[]结果媒体 URL 列表
media_info_listobject[]多媒体结果信息列表
codeint算法错误码;失败示例中为 26301

result.data 中字段说明

字段类型参数说明
media_info_listobject[]每项包含一个多媒体信息
parameterobject/null返回信息类型标识
error_codeint返回错误代码,0 表示成功
error_msgstring返回错误信息
msg_idstring请求唯一标识;原文说明该标识及算法结果只保留 24 小时
durationobject返回的详细耗时
extraobject扩展信息

media_info_list 中字段说明

字段名类型参数说明
media_datastring原字段表说明为 VAE 接口解码所需输入地址(如 .npy 文件 URL),本接口原返回示例为 mp4 URL
media_extranull预留字段,当前返回为 null
media_profilesobject媒体附加信息,字段说明见下表

media_profiles 中字段说明

字段类型参数说明
media_data_fpsfloat视频帧率
media_data_heightint视频高度
media_data_sizeint视频数据大小,单位为字节
media_data_typestring返回的 media_data 类型,如 url 表示地址
media_data_widthint视频宽度

duration 中字段说明

字段名类型参数说明
created_timestampint算法接收时间戳,单位为秒
pull_timestampint出队列时间戳,单位为秒
waiting_timeint队列中等待耗时,单位为毫秒
alg_process_timeint算法处理耗时,单位为毫秒,包含下载时间
upload_timeint上传耗时,单位为毫秒
repost_timeint异步回调接口耗时,单位为毫秒

extra 中字段说明

字段类型参数说明
trans_metaobject转码相关的元信息

trans_meta 中字段说明

字段类型参数说明
req_metaobject[]请求的媒体元信息列表
rsp_metaobject[]响应的媒体元信息列表

req_meta 中字段说明

字段类型参数说明
durationint媒体时长,单位为毫秒
media_typestring媒体类型,例如 video

rsp_meta 中字段说明

字段类型参数说明
data_ratefloat数据速率,单位为 bit/s
durationint媒体时长,单位为毫秒
frame_numint总帧数
frame_ratefloat帧率
heightint视频高度
media_typestring媒体类型,例如 video
sizeint文件大小,单位为字节
widthint视频宽度

返回值示例

请求成功返回示例

{
  "request_id": "",
  "trace_id": "",
  "code": 0,
  "error_code": 0,
  "message": "success",
  "tips": null,
  "data": {
    "status": 10,
    "result": {
      "id": "t_mt1a3i5n7bd3daeb87-14d2-40ce-a13c-744f8425cbf4",
      "urls": [
        "https://obs-large.mtlab.meitu.com/mtopen/4e200dc6bf574fee899cf9e0dabe27e6/d6311210-d2bb-4c17-6491-d8556cbaa134/d6311210-d2bb-4c17-6491-d8556cbaa134.mp4"
      ],
      "parameters": {
        "rsp_media_type": "url",
        "version": "2.0.0"
      },
      "data": {
        "duration": {
          "alg_process_time": 32102,
          "created_timestamp": 1759234231,
          "pull_timestamp": 1759234234,
          "repost_time": 0,
          "upload_time": 879,
          "waiting_time": 2754
        },
        "error_code": 0,
        "error_msg": "success",
        "extra": {},
        "media_info_list": [
          {
            "media_data": "https://obs-large.mtlab.meitu.com/mtopen/4e200dc6bf574fee899cf9e0dabe27e6/d6311210-d2bb-4c17-6491-d8556cbaa134/d6311210-d2bb-4c17-6491-d8556cbaa134.mp4",
            "media_extra": null,
            "media_profiles": {
              "media_data_type": "url"
            }
          }
        ],
        "msg_id": "8f7ae0f1-0d5a-4f53-4439-r0072c3dc457",
        "parameter": {
          "rsp_media_type": "url",
          "version": "2.0.0"
        }
      },
      "msg": "success",
      "msg_id": "8f7ae0f1-0d5a-4f53-4439-r0072c3dc457",
      "images": [
        "https://obs-large.mtlab.meitu.com/mtopen/4e200dc6bf574fee899cf9e0dabe27e6/d6311210-d2bb-4c17-6491-d8556cbaa134/d6311210-d2bb-4c17-6491-d8556cbaa134.mp4"
      ],
      "media_info_list": [
        {
          "media_data": "https://obs-large.mtlab.meitu.com/mtopen/4e200dc6bf574fee899cf9e0dabe27e6/d6311210-d2bb-4c17-6491-d8556cbaa134/d6311210-d2bb-4c17-6491-d8556cbaa134.mp4",
          "media_extra": null,
          "media_profiles": {
            "media_data_type": "url"
          }
        }
      ]
    },
    "progress": 1,
    "predict_elapsed": 10000,
    "create_time": 1759234231775,
    "task_id": "t_mt1a3i5n7bd3daeb87-14d2-40ce-a13c-744f8425cbf4",
    "custom_task_id": "",
    "trace_id": "f396c502-83c7-4e3f-adfb-85b7a325d000",
    "client_info": "",
    "init_images": null
  }
}

需要查询返回示例

使用 查询接口 接口查询

Response Status:200

content-type 为 application/json; charset=utf-8

{
  "request_id": "",
  "trace_id": "",
  "code": 0,
  "error_code": 0,
  "message": "success",
  "tips": null,
  "data": {
    "status": 9,
    "result": {
      "id": "t_mt1a3i5n7b3da6d589-46b5-4f66-a0bb-8dd22f2a172e"
    },
    "progress": 0,
    "predict_elapsed": 10000,
    "create_time": 1759202368761,
    "task_id": "t_mt1a3i5n7b3da6d589-46b5-4f66-a0bb-8dd22f2a172e",
    "custom_task_id": "",
    "trace_id": "9129a3a2-99c4-46ce-8731-0e100e2fbee7",
    "client_info": "",
    "init_images": null
  }
}

请求失败返回示例

Response Status:400

content-type 为 application/json; charset=utf-8

{
  "request_id": "",
  "trace_id": "",
  "code": 26301,
  "error_code": 26301,
  "message": "MTLABSDK - DEPENDENCY MISSING ERROR",
  "tips": null,
  "data": {
    "status": 2,
    "result": {
      "id": "t_mt1a3i5n7b62e3f245-cb93-468c-9a21-fa663656dd1d",
      "code": 26301,
      "data": {
        "duration": {
          "alg_process_time": 0,
          "created_timestamp": 1759232149,
          "pull_timestamp": 1759232149,
          "repost_time": 0,
          "upload_time": 0,
          "waiting_time": 81
        },
        "error_code": 26301,
        "error_msg": "MTLABSDK - DEPENDENCY MISSING ERROR",
        "extra": {},
        "media_info_list": [],
        "msg_id": "ffd2e88a-2b94-47ed-63c3-r00791cbcd50",
        "parameter": null
      },
      "msg": "MTLABSDK - DEPENDENCY MISSING ERROR",
      "msg_id": "ffd2e88a-2b94-47ed-63c3-r00791cbcd50"
    },
    "progress": 1,
    "predict_elapsed": 10000,
    "create_time": 1759232149156,
    "task_id": "t_mt1a3i5n7b62e3f245-cb93-468c-9a21-fa663656dd1d",
    "custom_task_id": "",
    "trace_id": "8d1a18ff-edae-4556-9c1a-89167249f91e",
    "client_info": "",
    "init_images": null
  }
}

通用的错误代码与信息

详见 API 错误码

SDK 调用示例

Python

import json

import requests
from sign_sdk import sign

def api_call_example():
    key = "your_api_key"
    secret = "your_api_secret"
    url = "https://openapi.meitu.com/api/v1/sdk/sync/push"
    method = "POST"

    headers = {
        "Content-Type": "application/json",
        sign.HeaderHost: "openapi.meitu.com",
    }
    inner_params = {
        "rsp_media_type": "url",
        "parameter": {
            "base": {
                "close_thresh": 0.2,
                "color_opt": True,
                "distance_error": 0.024,
                "distance_error_y_plus": 0.9,
                "enable_enhance": True,
                "enable_tune": True,
                "enhance_ratio": 1.0,
                "vis_ratio": 0.49,
                "vis_thresh": 0.91,
                "wink_opt": False,
            },
            "extra": {},
            "version": "2.0.0",
        },
    }
    payload = {
        "task": "/v1/mtgazecorrect_v2_vid/481969",
        "task_type": "formula",
        "init_images": [
            {
                "url": "https://obs.mtlab.meitu.com/public/EtRGxLI8ulQ43pGhuZfym9aYUD2PUbMP/MTc0OTc4MDAwMA==/0281e99d-c48a-497f-5812-6ef391e200e3.mp4",
                "profile": {
                    "media_profiles": {"media_data_type": "url"},
                    "version": "v1",
                },
            }
        ],
        "params": json.dumps(inner_params, ensure_ascii=False),
        "sync_timeout": 30,
    }
    body = json.dumps(payload, ensure_ascii=False)

    signer = sign.Signer(key, secret)
    signed_request = signer.sign(url, method, headers, body)
    response = requests.Session().send(signed_request)
    print(f"Status: {response.status_code}")
    print(f"Response: {response.text}")

if __name__ == "__main__":
    api_call_example()

Go

package main

import (
	"fmt"
	"io"
	"net/http"

	"github.com/mtlab/api/signer"
)

func main() {
	key := "your_api_key"
	secret := "your_api_secret"
	signObj := signer.NewSigner(key, secret)

	url := "https://openapi.meitu.com/api/v1/sdk/sync/push"
	method := http.MethodPost
	headers := make(http.Header)
	headers.Set(signer.HeaderHost, "openapi.meitu.com")
	headers.Set("Content-Type", "application/json")

	body := `{
  "task": "/v1/mtgazecorrect_v2_vid/481969",
  "task_type": "formula",
  "init_images": [{
    "url": "https://obs.mtlab.meitu.com/public/EtRGxLI8ulQ43pGhuZfym9aYUD2PUbMP/MTc0OTc4MDAwMA==/0281e99d-c48a-497f-5812-6ef391e200e3.mp4",
    "profile": {
      "media_profiles": {"media_data_type": "url"},
      "version": "v1"
    }
  }],
  "params": "{\"rsp_media_type\":\"url\",\"parameter\":{\"base\":{\"close_thresh\":0.2,\"color_opt\":true,\"distance_error\":0.024,\"distance_error_y_plus\":0.9,\"enable_enhance\":true,\"enable_tune\":true,\"enhance_ratio\":1.0,\"vis_ratio\":0.49,\"vis_thresh\":0.91,\"wink_opt\":false},\"extra\":{},\"version\":\"2.0.0\"}}",
  "sync_timeout": 30
}`

	req, err := signObj.Sign(url, method, headers, body)
	if err != nil {
		fmt.Println("Failed to sign request:", err)
		return
	}
	resp, err := http.DefaultClient.Do(req)
	if err != nil {
		fmt.Println("Failed to send request:", err)
		return
	}
	defer resp.Body.Close()

	responseBody, err := io.ReadAll(resp.Body)
	if err != nil {
		fmt.Println("Read response failed:", err)
		return
	}
	fmt.Println("Response:", resp.StatusCode, string(responseBody))
}

PHP

<?php
require 'signer.php';

$key = 'your_api_key';
$secret = 'your_api_secret';
$signer = new Signer($key, $secret);

$url = 'https://openapi.meitu.com/api/v1/sdk/sync/push';
$method = 'POST';
$headers = ['Content-Type' => 'application/json'];

$innerParams = json_encode([
    'rsp_media_type' => 'url',
    'parameter' => [
        'base' => [
            'close_thresh' => 0.2,
            'color_opt' => true,
            'distance_error' => 0.024,
            'distance_error_y_plus' => 0.9,
            'enable_enhance' => true,
            'enable_tune' => true,
            'enhance_ratio' => 1.0,
            'vis_ratio' => 0.49,
            'vis_thresh' => 0.91,
            'wink_opt' => false,
        ],
        'extra' => [],
        'version' => '2.0.0',
    ],
]);

$body = json_encode([
    'task' => '/v1/mtgazecorrect_v2_vid/481969',
    'task_type' => 'formula',
    'init_images' => [
        [
            'url' => 'https://obs.mtlab.meitu.com/public/EtRGxLI8ulQ43pGhuZfym9aYUD2PUbMP/MTc0OTc4MDAwMA==/0281e99d-c48a-497f-5812-6ef391e200e3.mp4',
            'profile' => [
                'media_profiles' => ['media_data_type' => 'url'],
                'version' => 'v1',
            ],
        ],
    ],
    'params' => $innerParams,
    'sync_timeout' => 30,
]);

$curl = $signer->sign($url, $method, $headers, $body);
$response = curl_exec($curl);
$status = curl_getinfo($curl, CURLINFO_HTTP_CODE);

if ($status === 0) {
    echo 'Error: ' . curl_error($curl);
} else {
    echo "Status: {$status}\n";
    echo "Response: {$response}\n";
}
curl_close($curl);
?>

Java

package com.meitu.openai.common;

import java.io.BufferedReader;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.net.HttpURLConnection;
import java.net.URL;
import java.nio.charset.StandardCharsets;
import java.util.HashMap;
import java.util.Map;

public class Main {
    public static void main(String[] args) throws Exception {
        Signer signer = new Signer("your_api_key", "your_api_secret");
        String url = "https://openapi.meitu.com/api/v1/sdk/sync/push";
        String method = "POST";

        Map<String, String> headers = new HashMap<>();
        headers.put("Content-Type", "application/json");
        headers.put(Signer.HeaderHost, "openapi.meitu.com");

        String body = "{\n" +
                "  \"task\": \"/v1/mtgazecorrect_v2_vid/481969\",\n" +
                "  \"task_type\": \"formula\",\n" +
                "  \"init_images\": [{\n" +
                "    \"url\": \"https://obs.mtlab.meitu.com/public/EtRGxLI8ulQ43pGhuZfym9aYUD2PUbMP/MTc0OTc4MDAwMA==/0281e99d-c48a-497f-5812-6ef391e200e3.mp4\",\n" +
                "    \"profile\": {\n" +
                "      \"media_profiles\": {\"media_data_type\": \"url\"},\n" +
                "      \"version\": \"v1\"\n" +
                "    }\n" +
                "  }],\n" +
                "  \"params\": \"{\\\"rsp_media_type\\\":\\\"url\\\",\\\"parameter\\\":{\\\"base\\\":{\\\"close_thresh\\\":0.2,\\\"color_opt\\\":true,\\\"distance_error\\\":0.024,\\\"distance_error_y_plus\\\":0.9,\\\"enable_enhance\\\":true,\\\"enable_tune\\\":true,\\\"enhance_ratio\\\":1.0,\\\"vis_ratio\\\":0.49,\\\"vis_thresh\\\":0.91,\\\"wink_opt\\\":false},\\\"extra\\\":{},\\\"version\\\":\\\"2.0.0\\\"}}\",\n" +
                "  \"sync_timeout\": 30\n" +
                "}";

        Map<String, String> signedHeaders = signer.sign(url, method, headers, body);
        HttpURLConnection connection = (HttpURLConnection) new URL(url).openConnection();
        connection.setRequestMethod(method);
        for (Map.Entry<String, String> entry : signedHeaders.entrySet()) {
            connection.setRequestProperty(entry.getKey(), entry.getValue());
        }
        connection.setDoOutput(true);
        connection.getOutputStream().write(body.getBytes(StandardCharsets.UTF_8));

        int status = connection.getResponseCode();
        InputStream stream = status >= 400
                ? connection.getErrorStream()
                : connection.getInputStream();
        try (BufferedReader reader = new BufferedReader(new InputStreamReader(stream))) {
            StringBuilder response = new StringBuilder();
            String line;
            while ((line = reader.readLine()) != null) {
                response.append(line);
            }
            System.out.println("Response: " + status + " " + response);
        }
    }
}