MI ISP API

---

REVISION HISTORY

Revision No.	Description	Date
3.0	Initial release	12/04/2020
3.1	Added new API: MI_ISP_SetCustSegAttr, MI_ISP_GetCustSegAttr, MI_ISP_GetCustSegBuf, MI_ISP_PutCustSegBuf Update API: MI_ISP_SetChnParam	07/25/2021
	Added PROCFS INTRODUCTION	08/25/2021
3.2	Added new API: MI_ISP_GetSubChnId	11/23/2021
3.3	Added Mochi Info	02/17/2022
3.4	Added Maruko info	03/21/2022
3.5	Added new API: MI_ISP_SetSubChnParam, MI_ISP_GetSubChnParam, MI_ISP_SetChnOverlapAttr, MI_ISP_GetChnOverlapAttr Update API: MI_ISP_SetOutputPortParam	05/23/2022
3.6	In Section 5.2 add debug CMD:ptsth/sendoneframe/dnrlevel/resethw/crcmode/datagen/cmdqtimeout	08/03/2022
3.7	Added Opera Info In Section 3.6 add new Hdr type E_MI_ISP_HDR_TYPE_DCG	10/28/2022
3.8	modify isp support max channel	12/01/2022
3.9	In Section 3.6 modify Hdr type MI_ISP_HDRType_e	1/11/2023
3.10	Added Souffle Info	02/14/2023
3.11	Added Pcupid Info	04/10/2024
3.12	Modify doc structure	04/27/2024
3.13	Added Ifackel Info Add new API: MI_ISP_SetLdcAttr	05/12/2025
3.14	Added Jaguar1 Info	05/12/2025
3.15	Added Iford Info	05/12/2025
3.16	Section 2 add new api: MI_ISP_AiIspInit, MI_ISP_AiIspDeinit, MI_ISP_SetAiBnrAttr, MI_ISP_LoadAiBnrModel, MI_ISP_UnloadAiBnrModel, MI_ISP_SetAi3dnrAttr, MI_ISP_GetAi3dnrAttr, MI_ISP_LoadAi3dnrModel, MI_ISP_UnloadAi3dnrModel Section 3 add new datatype: MI_ISP_AiBnrAttr_t, MI_ISP_AiBnrSourceType_e, MI_ISP_Ai3dnrAttr_t, MI_ISP_Ai3dnrModelParam_t	05/15/2025
3.17	Add new item for MI_ISP_ZoomEntry_t	05/12/2025
3.18	Added Ifliegen Info	06/16/2025
3.19	Update AIISP by merge the ai_isp doc to this file and remove cust seg	10/11/2025
3.20	Sync documents	11/20/2025

---

1. Overview

1.1. Module description

ISP (Image Signal Processing) realizes HDR, 3D/2D noise reduction, 3A algorithm, WDR and other related functions.

Keyword

• Device

  Hardware device.

• channel

  Time division multiplexed channel on device.

• DNR

  Digital Noise Reduction.

  2D Noise Reduction: average a pixel with surrounding pixels, and the noise will be reduced after that, but the picture will be blurred;

  3D Noise Reduction: add time domain processing, 2D noise reduction only considers one frame of image, while 3D noise reduction considers the time domain relationship between frames, and averages each pixel in time domain.

• 3A algorithm

  AE (Auto Exposure), AWB (Auto White Balance), and AF(Auto Focus).

• IQ

  IQ (Image Quality) is a quality evaluation standard for images captured by cameras, covering multiple aspects such as resolution, color reproduction, contrast, noise, dynamic range, gamma correction, lens distortion, etc.

• HDR

  High-Dynamic Range.

  According to the LDR (Low-Dynamic Range) of different exposure times, the final HDR image is synthesized using the LDR image with the best detail corresponding to each exposure time. It can better reflect the visual effects in the real environment.

• WDR

  Wide Dynamic Range.

  After turning it on, the bright and dark parts of the scene can be seen clearly. The wide dynamic range is the ratio of the brightest and the darkest signal value that the image can distinguish.

• Rotation

  Rotate the original image around the center point by 0°/90°/180°/270°.

• mirror

  Horizontal mirror flip.

• Flip

  Mirror up and down.

• Crop

  Crop the image.

• seg

  Segment module.

• Compress

  Compress mode, compress data transmission to save bandwidth.

• IR

  IR Data of RGBIR sensor.

• AIISP

  Somewhere in the ISP pipeline, an AI (artificial intelligence) algorithm is used to optimize the image before it is sent back to the ISP for further processing. The purpose is to use the powerful computing power of AI to supplement the ISP and obtain higher quality images.

1.2. Basic Structure

Simply put, ISP receives the input image from the front end, processes it through the ISP's internal functional modules, and outputs the processed image.

Figure 1-1 ISP basic framework diagram

Input Stage

There are two forms of ISP input:

1. Direct connection to the front-end IP hardware (such as VIF), directly sending data to the ISP, this mode is called realtime. In this mode, only one channel of data from the front end is supported, and multiple channels of data are not supported.

2. Read from the system memory in the form of a buffer. The data source of the buffer can be written by the front-end IP, or directly poured in by the user through the MI_SYS interface. This mode is called framemode. In this mode, multiple channels of data from the front end can be supported to be input simultaneously, and the ISP processes these multiple channels of data in the form of time-division multiplexing.

Process Stage

1. ISP pipeline is the main processing process of ISP, which involves multiple hardware functions. The functions of each generation of chips are inconsistent, so it is not expanded in detail here. For details, please refer to 1.3. Function Introduction and 1.5. Chip Differences

2. CUS3A runs the 3A algorithm. It obtains image statistics from the ISP pipeline, sends them to the 3A algorithm to get the results, and then sends them back to the ISP pipeline. For details of this part, please refer to: [AE/AWB/AF Interface]

3. IQ is used to control image quality. Users use specific tools to manually or automatically adjust image quality. It obtains parameters from the ISP pipeline and sets new parameters to the ISP pipeline, thereby affecting image quality. For details of this part, please refer to: [ISP Software Development Reference] and [ISP API Tuning SOP]

Output Stage

There are also two output forms for images processed by ISP:

1. Direct connection to the back-end IP hardware (such as SCL or LDC), that is, realtime, which can be output to multiple back-end IPs at the same time.

2. Written to the system memory in the form of a buffer, that is, framemode, the user and the back-end module can directly obtain the content from the output buffer.

Note that realtime and framemode can be used at the same time when outputting.

1.3. Functions Introduction

MI_ISP supports the following functions:

1. Rotate, flip and mirror the image

2. Crop the image

3. HDR fusion of the input long and short exposure images

4. De-noise the image in the temporal and spatial domains (3DNR)

5. Apply the 3A algorithm to adjust the image effect

6. Perform WDR processing on the image

7. Adjust the IQ parameters to obtain different image quality and effects

8. Correct the image distortion through the built-in 1D-LDC

9. Convert the input bayer format image to YUV format

Note that not every generation of chips has all the functions described above. For details, please refer to 1.5. Chip Differences

1.4. Application scenarios

MI_ISP can be applied to the following scenarios:

• Pure linux scenario

  In the linux environment, you can develop based on the API interface provided by MI_ISP.

• Pure rtos scenario

  In the rtos environment, applications can be developed based on the API interface provided by MI_ISP.

• Dualos scenario

  In the dualos environment, applications running on the linux side and applications running on the rtos side can be developed based on the MI_ISP API.

1.5. Chip Differences

The chip described in this document is Iford

1.5.1. Specifications

Both ‘\’ and ‘N’ means this function is not supported.

• Module function specifications

  Function	Tiramisu	Mochi	Muffin	Maruko	Opera	Souffle	Pcupid	Ifackel	Jaguar1	Iford	Ifliegen
  Dev Number	1	1	2	1	1	1	1	1	1	1	1
  Chn Number	32	32	32	4	5	4	4	4	4	4	4
  Port Number	3	2	3	3	3	4	3	4	4	4	2
  DNR Range	0-2	0-7	0-2	0-6	0-2	0-5	0-2	0-5	0-5	0-6	0-6
  InputCrop	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  3A	Y	N	Y	Y	Y	Y	Y	Y	Y	Y	Y
  2F HDR	Y	N	Y	Y	Y	Y	N	Y	Y	Y	Y
  3F HDR	N	N	N	N	N	Y	N	N	N	N	N
  Rotation	Y	N	Y	Y	Y	Y	N	Y	Y	Y	Y
  mirror	Y	N	Y	Y	Y	Y	N	Y	Y	Y	Y
  flip	Y	N	Y	Y	Y	Y	N	Y	Y	Y	Y
  WDR	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  OutPutCrop	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  IR	Y	N	Y	Y	Y	Y	Y	Y	Y	Y	N
  Compress	Y	Y	Y	Y	Y	Y	Y	Y	N	N	Y
  Max Pixel Rate	4K30	4K60	4K60	4K30	6M30	16M30	2M30	4K24	4K30	8M24	4K25

• Input specifications

  Input		Tiramisu	Mochi	Muffin	Maruko	Opera	Souffle	Pcupid	Ifackel	Jaguar1	Iford	Ifliegen
  Pixel	yuv422 YUYV	Y	N	Y	Y	N	Y	Y	Y	Y	Y	Y
  	yuv422 UYVY	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	Bayer	Y	N	Y	Y	Y	Y	Y	Y	Y	Y	Y
  Compress	NONE	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	TO_8BIT	Y	N	Y	Y	Y	Y	Y	Y	Y	N	Y
  	TO_6BIT	N	Y	N	N	N	N	N	N	N	N	N
  	SFBC0	N	Y	N	N	N	N	N	N	N	N	N
  Crop		Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  resolution	MAX	4208	3840	4068	3840	2688	4680	1920	3840	3840	3840	3840
  	MIN	320x256(Enable AE) 16x16(Disable AE)	16x16	320x256(Enable AE) 16x16(Disable AE)	320x256(Enable AE) 16x16(Disable AE)	320x256(Enable AE) 16x16(Disable AE)	128x120(Enable AE) 16x16(Disable AE)	320x256(Enable AE) 16x16(Disable AE)	320x256	320x256	320x256(Enable AE) 16x16(Disable AE)	320x256
  Pixel Alignment (WxH)	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2

• Output specifications

  Output		Tiramisu	Mochi	Muffin	Maruko	Opera	Souffle	Pcupid	Ifackel	Jaguar1	Iford	Ifliegen
  Pixel	ARGB8888	N	Y	N	Y	Y	Y	Y	Y	Y	N	Y
  	ABGR8888	N	N	N	Y	Y	Y	Y	Y	Y	N	Y
  	BGRA8888	N	N	N	Y	Y	Y	Y	Y	Y	N	Y
  	yuv420SP NV12	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv420SP NV21	N	Y	N	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv420 Planer	N	Y	N	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 YUYV	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 YVYU	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 VYUY	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 UYVY	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 SP	N	Y	N	Y	Y	Y	Y	Y	Y	Y	Y
  	yuv422 Planer	N	Y	N	Y	Y	Y	Y	Y	Y	Y	Y
  Compress	NONE	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  	10TO6	N	Y	N	Y	Y	Y	N	Y	N	N	N
  Crop		Y	Y	Y	Y	Y	Y	Y	Y	Y	Y	Y
  IR		Y	N	Y	Y	Y	Y	Y	Y	Y	Y	N
  Pixel Alignment (WxH)		2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2	2x2

1.5.2. Flow chart

1.5.2.1. Tiramisu

Figure 1‑2 Tiramisu flow chart

Note:

• Tiramisu only has a device0, and each device supports up to 16 channels.

• Only YUV422_yuyv / uyvy and Bayer format input are supported, Bayer format can support 3DNR and 3a functions.

1.5.2.2. Muffin

Figure 1‑3 Muffin flow chart

Note:

• Muffin has Device0 and Device1, and each Device supports up to 16 channels.

• Only supports YUV422_YUYV/UYVY and bayer format input.

1.5.2.3. Mochi

Figure 1‑4 Mochi flow chart

Note:

• Mochi only has a device0, and each device supports up to 16 channels.

• Only YUV422_uyvy format input are supported.

• Do not support HDR/Rotation/Mirror/Flip.

1.5.2.4. Maruko

Figure 1‑5 Maruko flow chart

Note:

• Maruko only has a device0, and each device supports up to 16 channels.

• Only YUV422_yuyv / uyvy and Bayer format input are supported, Bayer format can support 3DNR/3A/Rot functions.

1.5.2.5. Opera

Figure 1‑6 Opera flow chart

Note:

• Opera only has a device0, and each device supports up to 5 channels.

• Only YUV422_UYVY and Bayer input format are supported, and only Bayer format can support 3DNR/3A/Rot functions.

1.5.2.6. Souffle

Figure 1‑7 Souffle flow chart

Note:

• Souffle only has a device0, and each device supports up to 4 channels.

• Only YUV422_YUYV / YUV422_UYVY and Bayer input format are supported, and only Bayer format can support 3DNR/3A/Rot functions.

1.5.2.7. Pcupid

Figure 1‑8 Pcupid flow chart

Note:

• Pcupid only has a device0, and each device supports up to 4 channels.

• Only YUV422_YUYV / YUV422_UYVY and Bayer input format are supported, and only Bayer format can support 3DNR/3A functions.

• Do not support HDR/Rotation/Mirror/Flip.

1.5.2.8. Ifackel

Figure 1-9 Ifackel flow chart

Note:

• Ifackel only has a device0, and each device supports up to 4 channels.
• Only YUV422_YUYV / YUV422_UYVY and Bayer input format are supported, and only Bayer format can support 3DNR/3A/Rot functions.

1.5.2.9. Jaguar1

Figure 1-10 Jaguar1 flow chart

Note:

• Jaguar1 only has a device0, and each device supports up to 4 channels.
• Only YUV422_YUYV / YUV422_UYVY and Bayer input format are supported, and YUV422 format with Y2B enable and Bayer format can support 3DNR/3A/Rot functions.

1.5.2.10. Iford

Figure 1-11 Iford flow chart

Note:

• Iford only has a device0, and each device supports up to 4 channels.

• Only YUV422_UYVY/ YUV422_YUYV and Bayer input format are supported, and only Bayer format can support 3DNR/3A/Rot functions.

1.5.2.11. Ifliegen

Figure 1-12 Ifliegen flow chart

Note:

• Ifliegen only has a device0, and each device supports up to 4 channels.

• Only YUV422_UYVY/ YUV422_YUYV and Bayer input format are supported, and only Bayer format can support 3DNR/3A/Rot functions.

1.6. Working principle

NA

1.7. Interface calling

Figure 1‑9 MI_ISP call flow chart

The interface call of MI_ISP is divided into the following steps:

1. Initialize MI_SYS

2. Create MI_ISP Device

3. Create MI_ISP Channel

4. Set the parameters of MI_ISP Channel

5. Start MI_ISP Channel

6. Set the parameters of MI_ISP Output port

7. Enable MI_ISP Output port

8. Set the MI_ISP Output port depth

9. If MI_ISP has front-end and back-end modules, call MI_SYS interface to bind MI_ISP with front-end and back-end modules

10. Front-end or SYS pushes stream to ISP, SYS gets stream from ISP or ISP pushes stream to back-end

11. Disable the enabled MI_ISP Output port

12. Stop MI_ISP Channel

13. Destroy MI_ISP Channel

14. Destroy MI_ISP Device

15. Deinitialize MI_SYS

1.8. Example

1.8.1 Example 1

The first example introduces the initialization and deinitialization procedures of the MI_ISP module.

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <signal.h>
#include <unistd.h>

#include "mi_sys.h"
#include "mi_isp.h"

#define ExecFunc(_func_,_ret_)                               \
    if((_func_) != (_ret_))                                  \
    {                                                        \
        printf("[ %d ] exec function is failed\n",__LINE__); \
        exit(-1);                                            \
    }                                                        \
    else                                                     \
    {                                                        \
        printf("[ %d ] exec function is success\n",__LINE__);\
    }


MI_S32 IspModuleInit(MI_ISP_DEV ispDevId, MI_ISP_CHANNEL ispChnId, MI_ISP_PORT ispPortId)
{
    // create isp device
    MI_ISP_DevAttr_t ispDevAttr;
    memset(&ispDevAttr, 0x0, sizeof(MI_ISP_DevAttr_t));
    ispDevAttr.u32DevStitchMask = 0;

    ExecFunc(MI_ISP_CreateDevice(ispDevId, &ispDevAttr), MI_SUCCESS);

    // create isp channel
    MI_ISP_ChannelAttr_t ispChnAttr;
    memset(&ispChnAttr, 0x0, sizeof(MI_ISP_ChannelAttr_t));

    ExecFunc(MI_ISP_CreateChannel(ispDevId, ispChnId, &ispChnAttr), MI_SUCCESS);

    // set isp channel param
    MI_ISP_ChnParam_t ispChnParam;
    memset(&ispChnParam, 0x0, sizeof(MI_ISP_ChnParam_t));
    ispChnParam.eHDRType = E_MI_ISP_HDR_TYPE_OFF;
    ispChnParam.e3DNRLevel = E_MI_ISP_3DNR_LEVEL1;
    ispChnParam.eRot = E_MI_SYS_ROTATE_90;
    ExecFunc(MI_ISP_SetChnParam(ispDevId, ispChnId, &ispChnParam), MI_SUCCESS);

    // start isp channel
    ExecFunc(MI_ISP_StartChannel(ispDevId, ispChnId), MI_SUCCESS);

    // set isp output port param
    MI_ISP_OutPortParam_t ispOutputParam;
    memset(&ispOutputParam, 0x0, sizeof(MI_ISP_OutPortParam_t));
    ispOutputParam.ePixelFormat = E_MI_SYS_PIXEL_FRAME_YUV_SEMIPLANAR_420;

    ExecFunc(MI_ISP_SetOutputPortParam(ispDevId, ispChnId, ispPortId, &ispOutputParam), MI_SUCCESS);

    // enable isp output port
    ExecFunc(MI_ISP_EnableOutputPort(ispDevId, ispChnId, ispPortId), MI_SUCCESS);

    // set isp output port depth
    MI_SYS_ChnPort_t chnPort;
    chnPort.eModId = E_MI_MODULE_ID_ISP;
    chnPort.u32DevId = ispDevId;
    chnPort.u32ChnId = ispChnId;
    chnPort.u32PortId = ispPortId;

    ExecFunc(MI_SYS_SetChnOutputPortDepth(0, &chnPort, 1, 4), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 IspModuleDeinit(MI_ISP_DEV ispDevId, MI_ISP_CHANNEL ispChnId, MI_ISP_PORT ispPortId)
{
    ExecFunc(MI_ISP_DisableOutputPort(ispDevId, ispChnId,ispPortId), MI_SUCCESS);
    ExecFunc(MI_ISP_StopChannel(ispDevId,ispChnId), MI_SUCCESS);
    ExecFunc(MI_ISP_DestroyChannel(ispDevId, ispChnId), MI_SUCCESS);
    ExecFunc(MI_ISP_DestoryDevice(ispDevId), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_BOOL bExit = FALSE;

void signalHandler(int signo)
{
    printf("ctrl +c is input \n");
    bExit = TRUE;
    return;
}

int main(int argc, char **argv)
{
    MI_ISP_DEV ispDevId = 0;
    MI_ISP_CHANNEL ispChnId = 0;
    MI_ISP_PORT ispPortId = 1;

    ExecFunc(MI_SYS_Init(0), MI_SUCCESS);

    ExecFunc(IspModuleInit(ispDevId, ispChnId, ispPortId), MI_SUCCESS);

    signal(SIGINT, signalHandler);
    while (!bExit)
    {
        sleep(1);
    }

    ExecFunc(IspModuleDeinit(ispDevId, ispChnId, ispPortId), MI_SUCCESS);

    ExecFunc(MI_SYS_Exit(0), MI_SUCCESS);

    return 0;
}

1.8.2. Example 2

The second example uses a classic pipeline, namely sensor -> vif -> isp -> scl, where framemode is used to connect vif->isp, and realitme is used to connect isp->scl. For the flow of the front-end and back-end modules, only the demo code is given here without much explanation. For in-depth understanding, please refer to the corresponding documents: sensor, vif, scl

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <signal.h>
#include <unistd.h>

#include "mi_sensor.h"
#include "mi_sensor_datatype.h"
#include "mi_vif.h"
#include "mi_isp.h"
#include "mi_scl.h"
#include "mi_sys.h"


#define ExecFunc(_func_,_ret_)                               \
    if((_func_) != (_ret_))                                  \
    {                                                        \
        printf("[ %d ] exec function is failed\n",__LINE__); \
        exit(-1);                                            \
    }                                                        \
    else                                                     \
    {                                                        \
        printf("[ %d ] exec function is success\n",__LINE__);\
    }

typedef struct
{
    MI_SYS_ChnPort_t srcChnPort;
    MI_SYS_ChnPort_t dstChnPort;
    MI_U32 srcFrmrate;
    MI_U32 dstFrmrate;
    MI_SYS_BindType_e bindType;
    MI_U32 bindParam;
} Sys_BindInfo_t;

MI_S32 SysBind(Sys_BindInfo_t *pstBindInfo)
{
    ExecFunc(MI_SYS_BindChnPort2(0, &pstBindInfo->srcChnPort, &pstBindInfo->dstChnPort,
        pstBindInfo->srcFrmrate, pstBindInfo->dstFrmrate, pstBindInfo->bindType, pstBindInfo->bindParam),
        MI_SUCCESS);
    printf("\n");
    printf("src(%d-%d-%d-%d)  dst(%d-%d-%d-%d)  %d...\n", pstBindInfo->srcChnPort.eModId, pstBindInfo->srcChnPort.u32DevId,
        pstBindInfo->srcChnPort.u32ChnId, pstBindInfo->srcChnPort.u32PortId,
        pstBindInfo->dstChnPort.eModId, pstBindInfo->dstChnPort.u32DevId, pstBindInfo->dstChnPort.u32ChnId,
        pstBindInfo->dstChnPort.u32PortId, pstBindInfo->bindType);
    printf("\n");

    return MI_SUCCESS;
}

MI_S32 SysUnBind(Sys_BindInfo_t *pstBindInfo)
{
    ExecFunc(MI_SYS_UnBindChnPort(0, &pstBindInfo->srcChnPort, &pstBindInfo->dstChnPort), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 SnrModuleInit(MI_SNR_PADID snrPadId, MI_U8 resIdx, MI_BOOL useHdr)
{
    MI_SNR_SetPlaneMode(snrPadId, useHdr);
    MI_SNR_SetRes(snrPadId, resIdx);
    MI_SNR_Enable(snrPadId);

    return 0;
}

MI_S32 SnrModuleDeInit(MI_SNR_PADID snrPadId)
{
    MI_SNR_Disable(snrPadId);

    return 0;
}

MI_S32 VifModuleInit(MI_SNR_PADID snrPadId, MI_VIF_DEV vifDevId)
{
    MI_U8 vifGroupId = vifDevId;
    MI_VIF_PORT vifPort = 0;
    MI_U32 planeId = 0;

    MI_SNR_PADInfo_t  snrPad0Info;
    MI_SNR_PlaneInfo_t snrPlane0Info;
    memset(&snrPad0Info, 0x0, sizeof(MI_SNR_PADInfo_t));
    memset(&snrPlane0Info, 0x0, sizeof(MI_SNR_PlaneInfo_t));

    MI_VIF_GroupAttr_t vifGroupAttr;
    memset(&vifGroupAttr, 0x0, sizeof(MI_VIF_GroupAttr_t));

    ExecFunc(MI_SNR_GetPadInfo(snrPadId, &snrPad0Info), MI_SUCCESS);
    ExecFunc(MI_SNR_GetPlaneInfo(snrPadId, planeId, &snrPlane0Info), MI_SUCCESS);

    vifGroupAttr.eIntfMode = (MI_VIF_IntfMode_e)snrPad0Info.eIntfMode;
    vifGroupAttr.eWorkMode = E_MI_VIF_WORK_MODE_1MULTIPLEX;
    vifGroupAttr.eHDRType = (MI_VIF_HDRType_e)snrPad0Info.eHDRMode;
    vifGroupAttr.eClkEdge = E_MI_VIF_CLK_EDGE_DOUBLE;

    ExecFunc(MI_VIF_CreateDevGroup(vifGroupId, &vifGroupAttr), MI_SUCCESS);

    MI_VIF_DevAttr_t vifDevAttr;
    memset(&vifDevAttr, 0x0, sizeof(MI_VIF_DevAttr_t));

    vifDevAttr.stInputRect.u16X = snrPlane0Info.stCapRect.u16X;
    vifDevAttr.stInputRect.u16Y = snrPlane0Info.stCapRect.u16Y;
    vifDevAttr.stInputRect.u16Width = snrPlane0Info.stCapRect.u16Width;
    vifDevAttr.stInputRect.u16Height = snrPlane0Info.stCapRect.u16Height;
    if(snrPlane0Info.eBayerId >= E_MI_SYS_PIXEL_BAYERID_MAX)
    {
        vifDevAttr.eInputPixel = snrPlane0Info.ePixel;
    }
    else
    {
        vifDevAttr.eInputPixel = (MI_SYS_PixelFormat_e)RGB_BAYER_PIXEL(snrPlane0Info.ePixPrecision, snrPlane0Info.eBayerId);
    }

    printf("setchnportattr (%d,%d,%d,%d) \n", vifDevAttr.stInputRect.u16X, vifDevAttr.stInputRect.u16Y, vifDevAttr.stInputRect.u16Width, vifDevAttr.stInputRect.u16Height);
    ExecFunc(MI_VIF_SetDevAttr(vifDevId, &vifDevAttr), MI_SUCCESS);
    ExecFunc(MI_VIF_EnableDev(vifDevId), MI_SUCCESS);

    MI_VIF_OutputPortAttr_t vifPortInfo;
    memset(&vifPortInfo, 0, sizeof(MI_VIF_OutputPortAttr_t));

    vifPortInfo.stCapRect.u16X = 0;
    vifPortInfo.stCapRect.u16Y = 0;
    vifPortInfo.stCapRect.u16Width =  snrPlane0Info.stCapRect.u16Width;
    vifPortInfo.stCapRect.u16Height = snrPlane0Info.stCapRect.u16Height;
    vifPortInfo.stDestSize.u16Width = snrPlane0Info.stCapRect.u16Width;
    vifPortInfo.stDestSize.u16Height = snrPlane0Info.stCapRect.u16Height;
    printf("sensor bayerid %d, bit mode %d \n", snrPlane0Info.eBayerId, snrPlane0Info.ePixPrecision);
    vifPortInfo.ePixFormat = vifDevAttr.eInputPixel;
    //stVifPortInfo.u32FrameModeLineCount for lowlantancy mode
    vifPortInfo.eFrameRate = E_MI_VIF_FRAMERATE_FULL;

    ExecFunc(MI_VIF_SetOutputPortAttr(vifDevId, vifPort, &vifPortInfo), MI_SUCCESS);
    ExecFunc(MI_VIF_EnableOutputPort(vifDevId, vifPort), MI_SUCCESS);

    MI_SYS_ChnPort_t chnPort;
    chnPort.eModId = E_MI_MODULE_ID_VIF;
    chnPort.u32DevId = vifDevId;
    chnPort.u32ChnId = 0;
    chnPort.u32PortId = 0;

    MI_SYS_SetChnOutputPortDepth(0, &chnPort, 1, 4);

    return MI_SUCCESS;
}

MI_S32 VifModuleDeinit(MI_VIF_DEV VifDevId)
{
    MI_U8 u8VifGroupId = VifDevId;
    MI_VIF_PORT vifPort = 0;

    ExecFunc(MI_VIF_DisableOutputPort(VifDevId, vifPort), MI_SUCCESS);
    ExecFunc(MI_VIF_DisableDev(VifDevId), MI_SUCCESS);
    ExecFunc(MI_VIF_DestroyDevGroup(u8VifGroupId), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 IspModuleInit(MI_ISP_DEV ispDevId, MI_ISP_CHANNEL ispChnId, MI_ISP_PORT ispPortId, MI_SNR_PADID snrPadId)
{
    // create isp device
    MI_ISP_DevAttr_t ispDevAttr;
    memset(&ispDevAttr, 0x0, sizeof(MI_ISP_DevAttr_t));
    ispDevAttr.u32DevStitchMask = 0;

    ExecFunc(MI_ISP_CreateDevice(ispDevId, &ispDevAttr), MI_SUCCESS);

    // create isp channel
    MI_ISP_ChannelAttr_t ispChnAttr;
    memset(&ispChnAttr, 0x0, sizeof(MI_ISP_ChannelAttr_t));
    ispChnAttr.u32SensorBindId = (1 << snrPadId);

    ExecFunc(MI_ISP_CreateChannel(ispDevId, ispChnId, &ispChnAttr), MI_SUCCESS);

    // set isp channel param
    MI_ISP_ChnParam_t ispChnParam;
    memset(&ispChnParam, 0x0, sizeof(MI_ISP_ChnParam_t));
    ispChnParam.eHDRType = E_MI_ISP_HDR_TYPE_OFF;
    ispChnParam.e3DNRLevel = E_MI_ISP_3DNR_LEVEL1;
    ispChnParam.eRot = E_MI_SYS_ROTATE_90;
    ExecFunc(MI_ISP_SetChnParam(ispDevId, ispChnId, &ispChnParam), MI_SUCCESS);

    // start isp channel
    ExecFunc(MI_ISP_StartChannel(ispDevId, ispChnId), MI_SUCCESS);

    // set isp output port param
    MI_ISP_OutPortParam_t ispOutputParam;
    memset(&ispOutputParam, 0x0, sizeof(MI_ISP_OutPortParam_t));
    ispOutputParam.ePixelFormat = E_MI_SYS_PIXEL_FRAME_YUV_SEMIPLANAR_420;

    ExecFunc(MI_ISP_SetOutputPortParam(ispDevId, ispChnId, ispPortId, &ispOutputParam), MI_SUCCESS);

    // enable isp output port
    ExecFunc(MI_ISP_EnableOutputPort(ispDevId, ispChnId, ispPortId), MI_SUCCESS);

    // set isp output port depth
    MI_SYS_ChnPort_t chnPort;
    chnPort.eModId = E_MI_MODULE_ID_ISP;
    chnPort.u32DevId = ispDevId;
    chnPort.u32ChnId = ispChnId;
    chnPort.u32PortId = ispPortId;

    ExecFunc(MI_SYS_SetChnOutputPortDepth(0, &chnPort, 1, 4), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 IspModuleDeinit(MI_ISP_DEV ispDevId, MI_ISP_CHANNEL ispChnId, MI_ISP_PORT ispPortId)
{
    ExecFunc(MI_ISP_DisableOutputPort(ispDevId, ispChnId,ispPortId), MI_SUCCESS);
    ExecFunc(MI_ISP_StopChannel(ispDevId,ispChnId), MI_SUCCESS);
    ExecFunc(MI_ISP_DestroyChannel(ispDevId, ispChnId), MI_SUCCESS);
    ExecFunc(MI_ISP_DestoryDevice(ispDevId), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 SclModuleInit(MI_SCL_DEV sclDevId, MI_SCL_CHANNEL sclChnId, MI_SYS_WindowSize_t *pDstSize)
{
    MI_SCL_DevAttr_t sclDevAttr;
    MI_SCL_ChannelAttr_t  sclChnAttr;
    MI_SCL_ChnParam_t  sclChnParam;
    MI_SCL_OutPortParam_t  sclOutputParam;

    memset(&sclDevAttr, 0x0, sizeof(MI_SCL_DevAttr_t));
    memset(&sclChnAttr, 0x0, sizeof(MI_SCL_ChannelAttr_t));
    sclDevAttr.u32NeedUseHWOutPortMask = E_MI_SCL_HWSCL0;
    ExecFunc(MI_SCL_CreateDevice(sclDevId, &sclDevAttr), MI_SUCCESS);
    ExecFunc(MI_SCL_CreateChannel(sclDevId, sclChnId, &sclChnAttr), MI_SUCCESS);

    memset(&sclChnParam, 0x0, sizeof(MI_SCL_ChnParam_t));
    sclChnParam.eRot = E_MI_SYS_ROTATE_NONE;
    ExecFunc(MI_SCL_SetChnParam(sclDevId, sclChnId, &sclChnParam), MI_SUCCESS);
    ExecFunc(MI_SCL_StartChannel(sclDevId, sclChnId), MI_SUCCESS);

    memset(&sclOutputParam, 0x0, sizeof(MI_SCL_OutPortParam_t));
    memcpy(&sclOutputParam.stSCLOutputSize, pDstSize, sizeof(MI_SYS_WindowSize_t));
    sclOutputParam.ePixelFormat = E_MI_SYS_PIXEL_FRAME_YUV_SEMIPLANAR_420;
    sclOutputParam.eCompressMode = E_MI_SYS_COMPRESS_MODE_NONE;
    sclOutputParam.bMirror = FALSE;
    sclOutputParam.bFlip = FALSE;
    ExecFunc(MI_SCL_SetOutputPortParam((MI_SCL_DEV)sclDevId, sclChnId, 0, &sclOutputParam), MI_SUCCESS);

    ExecFunc(MI_SCL_EnableOutputPort((MI_SCL_DEV)sclDevId, sclChnId, 0), MI_SUCCESS);

    MI_SYS_ChnPort_t chnPort;
    chnPort.eModId = E_MI_MODULE_ID_SCL;
    chnPort.u32DevId = sclDevId;
    chnPort.u32ChnId = sclChnId;
    chnPort.u32PortId = 0;

    ExecFunc(MI_SYS_SetChnOutputPortDepth(0, &chnPort, 1, 4), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_S32 SclModuleDeinit(MI_SCL_DEV sclDevId, MI_SCL_CHANNEL sclChnId)
{
    ExecFunc(MI_SCL_DisableOutputPort(sclDevId, sclChnId,0), MI_SUCCESS);
    ExecFunc(MI_SCL_StopChannel(sclDevId,sclChnId), MI_SUCCESS);
    ExecFunc(MI_SCL_DestroyChannel(sclDevId, sclChnId), MI_SUCCESS);
    ExecFunc(MI_SCL_DestroyDevice(sclDevId), MI_SUCCESS);

    return MI_SUCCESS;
}

MI_BOOL bExit = FALSE;

void signalHandler(int signo)
{
    printf("ctrl +c is input \n");
    bExit = TRUE;
    return;
}

int main(int argc, char **argv)
{
    ExecFunc(MI_SYS_Init(0), MI_SUCCESS);

    MI_SNR_PADID snrPadId = 0;
    MI_U32 planeId = 0;
    MI_SNR_PlaneInfo_t snrPlaneInfo;
    memset(&snrPlaneInfo, 0, sizeof(MI_SNR_PlaneInfo_t));

    ExecFunc(SnrModuleInit(snrPadId, 0, FALSE), MI_SUCCESS);
    ExecFunc(MI_SNR_GetPlaneInfo(snrPadId, planeId, &snrPlaneInfo), MI_SUCCESS);

    MI_VIF_DEV vifDevId = 0;
    ExecFunc(VifModuleInit(snrPadId, vifDevId), MI_SUCCESS);

    MI_ISP_DEV ispDevId = 0;
    MI_ISP_CHANNEL ispChnId = 0;
    MI_ISP_PORT ispPortId = 0;
    ExecFunc(IspModuleInit(ispDevId, ispChnId, ispPortId, snrPadId), MI_SUCCESS);

    Sys_BindInfo_t vifIspBindInfo;
    memset(&vifIspBindInfo, 0x0, sizeof(Sys_BindInfo_t));

    vifIspBindInfo.srcChnPort.eModId = E_MI_MODULE_ID_VIF;
    vifIspBindInfo.srcChnPort.u32DevId = vifDevId;
    vifIspBindInfo.srcChnPort.u32ChnId = 0;
    vifIspBindInfo.srcChnPort.u32PortId = 0;

    vifIspBindInfo.dstChnPort.eModId = E_MI_MODULE_ID_ISP;
    vifIspBindInfo.dstChnPort.u32DevId = ispDevId;
    vifIspBindInfo.dstChnPort.u32ChnId = ispChnId;
    vifIspBindInfo.dstChnPort.u32PortId = 0;

    vifIspBindInfo.srcFrmrate = 30;
    vifIspBindInfo.dstFrmrate = 30;
    vifIspBindInfo.bindType = (MI_SYS_BindType_e)E_MI_SYS_BIND_TYPE_FRAME_BASE;

    ExecFunc(SysBind(&vifIspBindInfo), MI_SUCCESS);

    MI_SCL_DEV sclDevId = 0;
    MI_SCL_DEV sclChnId = 0;
    MI_SYS_WindowSize_t sclDstSize;
    sclDstSize.u16Width = snrPlaneInfo.stCapRect.u16Width;
    sclDstSize.u16Height = snrPlaneInfo.stCapRect.u16Height;

    SclModuleInit(sclDevId, sclChnId, &sclDstSize);

    Sys_BindInfo_t ispSclBindInfo;

    ispSclBindInfo.srcChnPort.eModId = E_MI_MODULE_ID_ISP;
    ispSclBindInfo.srcChnPort.u32DevId = ispDevId;
    ispSclBindInfo.srcChnPort.u32ChnId = ispChnId;
    ispSclBindInfo.srcChnPort.u32PortId = ispPortId;

    ispSclBindInfo.dstChnPort.eModId = E_MI_MODULE_ID_SCL;
    ispSclBindInfo.dstChnPort.u32DevId = sclDevId;
    ispSclBindInfo.dstChnPort.u32ChnId = sclChnId;
    ispSclBindInfo.dstChnPort.u32PortId = 0;

    ispSclBindInfo.srcFrmrate = 30;
    ispSclBindInfo.dstFrmrate = 30;
    ispSclBindInfo.bindType = E_MI_SYS_BIND_TYPE_REALTIME;

    ExecFunc(SysBind(&ispSclBindInfo), MI_SUCCESS);

    signal(SIGINT, signalHandler);
    while (!bExit)
    {
        sleep(1);
    }

    ExecFunc(SysUnBind(&ispSclBindInfo), MI_SUCCESS);

    ExecFunc(SclModuleDeinit(sclDevId, sclChnId), MI_SUCCESS);

    ExecFunc(SysUnBind(&vifIspBindInfo), MI_SUCCESS);

    ExecFunc(IspModuleDeinit(ispDevId, ispChnId, ispPortId), MI_SUCCESS);

    ExecFunc(VifModuleDeinit(vifDevId), MI_SUCCESS);

    ExecFunc(SnrModuleDeInit(snrPadId), MI_SUCCESS);

    ExecFunc(MI_SYS_Exit(0), MI_SUCCESS);

    return 0;
}

1.9. AIISP

AI ISP means that when the ISP is processing images, the data flow will enter the IPU, and the AI function of the IPU will be used to perform noise reduction, fusion and other processing on the image to obtain better image quality.

1.9.1. Ai Bnr

IPU is used to reduce the noise of images in the Bayer domain to obtain better image quality. It can be regarded as a module of ISP in terms of function. The effect of AI BNR on Ifackel can be improved by one level compared with traditional ISP, and the signal-to-noise ratio can be improved by about 6DB.

At present, AI BNR is mainly used in low or extremely low illumination scenes such as starlight, super starlight, and black light. Although increasing the aperture or sensor target position can improve the night vision effect, the cost is too high, while using AI BNR is cheaper.

1.9.2. Ai Wdr

An AI-based algorithm for adjusting the dynamic range of image display. It can better preserve the details of bright and dark areas (especially backlit areas) in wide dynamic scenes, while improving the overall contrast, thereby improving the imaging device's ability to capture details in wide dynamic scenes.

1.9.3. Flow Chart

1.9.3.1. Ifackel Ai Isp Chart

Figure 1-1: Ifackel AI BNR Chart

1.9.3.2. Ifliegen Ai Isp Chart

Figure 1-2: Ifliegen AI BNR Chart

Note:

• Ifliegen only support aibnr linear and aibnr hdr fusion, do not support aibnr hdr long

1.9.4. Keyword Description

• AI BNR Source

  Refers to the AI BNR mode.

  Linear: In linear mode, perform aibnr on the raw data after isp fe. Support vif bind isp realtime & frame mode.

  Fusion: In HDR mode, do AIBNR for the raw data output by the HDR module. Support vif bind isp realtime & frame mode.

  HDR long: Long exposure for HDR in HDR mode, do AIBNR in front of ISP module. Only supports VIF bind ISP frame mode.

  Note:

  • In hdr long mode, since raw is directly input to ipu, ipu eats raw after fbc, so fbc needs to be enabled on vif side.
  • When vif bind isp in frame mode, if AI BNR is enabled, you need to configure AI BNR source type and STA configuration for the VIF side at the same time. The usage diagram is shown in 2.1 demo.

2. API REFERENCE

This function module provides the following APIs:

API Name	Function
MI_ISP_CreateDevice	Create an ISP device
MI_ISP_DestroyDevice	Destroy an ISP device
MI_ISP_CreateChannel	Create an ISP channel
MI_ISP_DestroyChannel	Destroy an ISP channel
MI_ISP_SetInputPortCrop	Set ISP input port cropping parameter
MI_ISP_GetInputPortCrop	Get ISP input port cropping parameter
MI_ISP_SetChnParam	Set ISP channel parameter
MI_ISP_GetChnParam	Get ISP channel parameter
MI_ISP_StartChannel	Start ISP channel
MI_ISP_StopChannel	Stop ISP channel
MI_ISP_SetOutputPortParam	Set ISP output port parameter
MI_ISP_GetOutputPortParam	Get ISP output port parameter
MI_ISP_EnableOutputPort	Enable ISP output channel
MI_ISP_DisableOutputPort	Disable ISP output port
MI_ISP_Alloc_IQDataBuf	Allocate IQ data buffer
MI_ISP_Free_IQDataBuf	Release IQ data buffer
MI_ISP_CallBackTask_Register	Register ISP callback interface
MI_ISP_CallBackTask_Unregister	Unregister ISP callback interface
MI_ISP_SkipFrame	Set skip FrameNum
MI_ISP_LoadPortZoomTable	Load ISP port Zoom Table
MI_ISP_StartPortZoom	Start ISP port Zoom
MI_ISP_StopPortZoom	Stop ISP port Zoom
MI_ISP_GetPortCurZoomAttr	Get ISP port current Zoom attribute
MI_ISP_GetSubChnId	Get ISP subchannel ID
MI_ISP_SetSubChnParam	Set ISP subchannel parameter
MI_ISP_GetSubChnParam	Get ISP subchannel parameter
MI_ISP_SetChnOverlapAttr	Set ISP channel overlap attribute
MI_ISP_GetChnOverlapAttr	Get ISP channel overlap attribute
MI_ISP_SetLdcAttr	Set 1D-LDC attribute
MI_ISP_AiIspInit	Init AI ISP
MI_ISP_AiIspDeinit	Deinit AI ISP
MI_ISP_SetAiBnrAttr	Set AI BNR attribute
MI_ISP_GetAiBnrAttr	Get AI BNR attribute
MI_ISP_LoadAiBnrModel	Load AI BNR model
MI_ISP_UnloadAiBnrModel	Unload AI BNR model
MI_ISP_SetAiWdrAttr	Set AI WDR attribute
MI_ISP_GetAiWdrAttr	Get AI WDR attribute
MI_ISP_LoadAiWdrModel	Load AI WDR model
MI_ISP_UnloadAiWdrModel	Unload AI WDR model
MI_ISP_SetAi3dnrAttr	Set AI 3dnr attribute
MI_ISP_GetAi3dnrAttr	Get AI 3dnr attribute
MI_ISP_LoadAi3dnrModel	Load AI 3dnr model
MI_ISP_UnloadAi3dnrModel	Unload AI 3dnr model

2.1. MI_ISP_CreateDevice

• Description

  Create an ISP device.

• Syntax

  MI_S32 MI_ISP_CreateDevice(MI_ISP_DEV DevId, MI_ISP_DevAttr_t *pstDevAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID	Input
  pstDevAttr	ISP device attribute pointer. Static attribute.	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • Make sure that the ISP device is disabled before calling. If it is enabled, please use MI_ISP_DestroyDevice to disable it.

  • In function MI_ISP_CreateDevice, when parameter DevId = MI_ISP_CREATE_MULTI_DEV(MI_ISP_DEV0), isp is working in multi device mode. At this time, isp device 0 and isp device 1 is running in one channel.

  • Only Muffin supports multi device mode.

  • In multi device mode, use parameter DevId = MI_ISP_DEV0 when calling other isp api except MI_ISP_DestroyDevice.

• Example

  MI_ISP initialization:
  
  MI_S32 ST_IspModuleInit(MI_ISP_DEV IspDevId)
  {
  #define ST_MAX_ISP_OUTPORT_NUM (2)
      MI_ISP_CHANNEL IspChnId = 0;
      MI_ISP_PORT  IspOutPortId =0;
  
      MI_ISP_DevAttr_t stCreateDevAttr;
      memset(&stCreateDevAttr, 0x0, sizeof(MI_ISP_DevAttr_t));
      stCreateDevAttr.u32DevStitchMask = E_MI_ISP_DEVICE_ID0;
  
      MI_ISP_CreateDevice(IspDevId, &stCreateDevAttr);
  
      MI_ISP_ChannelAttr_t  stIspChnAttr;
      memset(&stIspChnAttr, 0x0, sizeof(MI_ISP_ChannelAttr_t));
      stIspChnAttr. u32SensorBindId = E_MI_ISP_SENSOR0;
      MI_ISP_CreateChannel(IspDevId, IspChnId, &stIspChnAttr);
  
      MI_SYS_WindowRect_t  stInputCropInfo;
      stInputCropInfo.u16x=0;
      stInputCropInfo.u16y=0;
      stInputCropInfo.u16width=0;
      stInputCropInfo.u16height=0;//width/height==0 no use crop.
      MI_ISP_SetInputPortCrop(IspDevId, IspChnId, &stInputCropInfo);
  
      MI_ISP_ChnParam_t  stChnParam;
      stChnParam.eHDRType = E_MI_ISP_HDR_TYPE_OFF;
      stChnParam.e3DNRLevel = E_MI_ISP_3DNR_LEVEL2;
      stChnParam.bMirror = FALSE;
      stChnParam.bFlip = FALSE;
      stChnParam.eRot = E_MI_SYS_ROTATE_NONE;
      //use rot or flip, 3dnr level must more than 0
      stChnParam.bY2bEnable = FALSE;
      MI_ISP_SetChnParam(IspDevId, IspChnId, &stChnParam);
  
      MI_ISP_StartChannel(IspDevId, IspChnId);
  
      for(IspOutPortId=0; IspOutPortId<ST_MAX_ISP_OUTPORT_NUM; IspOutPortId++)
      {
          MI_ISP_OutPortParam_t  stIspOutputParam;
          memset(&stIspOutputParam, 0x0, sizeof(MI_ISP_OutPortParam_t));
          stIspOutputParam.stCropRect.u16x=0;
          stIspOutputParam.stCropRect.u16y=0;
          stIspOutputParam.stCropRect.u16Width=0;
          stIspOutputParam.stCropRect.u16Height=0;//width/height use 0, not use crop
          stIspOutputParam.ePixelFormat = E_MI_SYS_PIXEL_FRAME_YUV_SEMIPLANAR_YUV420;
          MI_ISP_SetOutputPortParam(IspDevId, IspChnId, IspOutPortId, &stIspOutputParam);
          MI_ISP_EnableOutputPort(IspDevId, IspChnId, IspOutPortId);
      }
  
      return MI_SUCCESS;
  }
  

  MI_ISP de-initialization:

  MI_S32 ST_IspModuleUnInit(MI_ISP_DEV IspDevId)
  {
  #define ST_MAX_ISP_OUTPORT_NUM (2)
  
      MI_ISP_CHANNEL IspChnId = 0;
      MI_ISP_PORT  IspOutPortId =0;
  
      for(IspOutPortId=0; IspOutPortId<ST_MAX_ISP_OUTPORT_NUM; IspOutPortId++)
      {
          MI_ISP_DisableOutputPort(IspDevId, IspChnId, IspOutPortId);
      }
  
      MI_ISP_StopChannel(IspDevId, IspChnId);
  
      MI_ISP_DestroyChannel(IspDevId, IspChnId);
  
      MI_ISP_DestroyDevice(IspDevId);
  
      return MI_SUCCESS;
  }
  

• Related APIs

  MI_ISP_DestroyDevice

2.2. MI_ISP_DestroyDevice

• Description

  Destroy an ISP device.

• Syntax

  MI_S32 MI_ISP_DestroyDevice(MI_ISP_DEV DevId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  You need to disable all the output ports first, and then stop and destroy the channel to destroy device.

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_CreateDevice

2.3. MI_ISP_CreateChannel

• Description

  Create an ISP channel.

• Syntax

  MI_S32 MI_ISP_CreateChannel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ChannelAttr_t *pstChAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstChAttr	ISP channel attribute pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  Create device firstly, and then create channel.

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_DestroyChannel.

2.4. MI_ISP_DestroyChannel

• Description

  Destroy an ISP channel.

• Syntax

  MI_S32 MI_ISP_DestroyChannel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  You need to disable all the output ports first, and then stop channel, so that you can destroy channel.

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_CreateChannel

2.5. MI_ISP_SetInputPortCrop

• Description

  Set ISP input port cropping parameter.

• Syntax

  MI_S32 MI_ISP_SetInputPortCrop(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_SYS_WindowRect_t *pstCropInfo);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstCropInfo	ISP input port cropping parameter pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • When the input is Dram buffer, the input crop can be supported.

  • Crop x, Crop y, width, height are all aligned with 2.

  • The 3A inside the Isp only counts the information of the cropped area, which will affect the final 3A calculation result of the entire screen.

  • When the input data compression mode is not E_MI_SYS_COMPRESS_MODE_NONE, the input data does not support cropping.

2.6. MI_ISP_GetInputPortCrop

• Description

  Get ISP input port cropping parameter.

• Syntax

  MI_S32 MI_ISP_GetInputPortCrop(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_SYS_WindowRect_t *pstCropInfo);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstCropInfo	ISP input port cropping parameter pointer	output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.7. MI_ISP_SetChnParam

• Description

  Set ISP channel parameter.

• Syntax

  MI_S32 MI_ISP_SetChnParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ChnParam_t *pstChnParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstChnParam	ISP channel parameter pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  It is recommended to switch the channel parameters when the channel is stopped to avoid mismatch between the buffer and back-end parameters in the channel, which may cause an exception.

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_GetChnParam

2.8. MI_ISP_GetChnParam

• Description

  Get ISP channel parameter.

• Syntax

  MI_S32 MI_ISP_GetChnParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ChnParam_t *pstChnParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstChnParam	ISP channel parameter pointer	output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Related APIs

  MI_ISP_SetChnParam

2.9. MI_ISP_StartChannel

• Description

  Start ISP channel.

• Syntax

  MI_S32 MI_ISP_StartChannel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_SetChnParam

2.10. MI_ISP_StopChannel

• Description

  Stop ISP channel.

• Syntax

  MI_S32 MI_ISP_StopChannel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  You can stop the channel when created, and all the output port will have no data output.

• Example

  See the example of MI_ISP_CreateDevice.

2.11. MI_ISP_SetOutputPortParam

• Description

  Set ISP output port parameter.

• Syntax

  MI_S32 MI_ISP_SetOutputPortParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_PORT PortId, MI_ISP_OutPortParam_t *pstOutPortParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  PortId	ISP port ID	Input
  pstOutPortParam	ISP output port parameter pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • Output port0 can only bind with MI_SCL realtime, output area is the same as input, which has no need to call this API to set.

  • Output port1 support crop, and the output size need to be specified.

  • Output port2 only supports the output of the IR data of the RGBIR sensor. Output W/H is fixed at half of the input W/H, which has no need to call this API to set.

  • Output port3 can only bind with MI_LDC realtime, output area is the same as input, which has no need to call this API to set.

• Example

  See the example of MI_ISP_CreateDevice.

2.12. MI_ISP_GetOutputPortParam

• Description

  Get ISP output port parameter.

• Syntax

  MI_S32 MI_ISP_GetOutputPortParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_PORT PortId, MI_ISP_OutPortParam_t *pstOutPortParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  PortId	ISP port ID	Input
  pstOutPortParam	ISP output port parameter pointer	output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Related APIs

  MI_ISP_SetOutputPortParam

2.13. MI_ISP_EnableOutputPort

• Description

  Enable ISP output channel.

• Syntax

  MI_S32 MI_ISP_EnableOutputPort(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_PORT PortId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  PortId	ISP port ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • Output port1 can be enabled only when the attribute is set.

  • Output port2 can only be enabled when using RGBIR sensor.

• Example

  See the example of MI_ISP_CreateDevice.

• Related APIs

  MI_ISP_DisableOutputPort

2.14. MI_ISP_DisableOutputPort

• Description

  Disable ISP output port.

• Syntax

  MI_S32 MI_ISP_DisableOutputPort(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_PORT PortId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  PortId	ISP port ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.15. MI_ISP_Alloc_IQDataBuf

• Description

  Allocate IQ data buffer.

• Syntax

  MI_S32 MI_ISP_Alloc_IQDataBuf(MI_U32 u32Size,void **pUserVirAddr);
  

• Parameter

  Parameter name	Description	Input/Output
  u32Size	IQ data buffer size.	Input
  pUserVirAddr	IQ data buffer pointer address	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • It is recommended to use this api to apply for IQ api data to avoid the high risk of cpu loading caused by high frequency calls.

  • A thread applies for an isp data buffer to avoid buffer sharing between threads.

• Example

  #define  MI_ISP_MAX_DATA_SIZE  (80*1024)
  MI_ISP_Alloc_IQDataBuf(MI_ISP_MAX_DATA_SIZE, &pIspBuffer);
  MI_ISP_IQ_ColorToGrayType_t *pstColorToGray = (MI_ISP_IQ_ColorToGrayType_t *)pIspBuffer;
  MI_ISP_IQ_GetColorToGray( Channel, pstColorToGray);
  if(pstColorToGray->bEnable == SS_TRUE)
      pstColorToGray->bEnable = SS_FALSE;
  else
      pstColorToGray->bEnable = SS_TRUE;
  MI_ISP_IQ_SetColorToGray( Channel, pstColorToGray);
  
  MI_ISP_IQ_ContrastType_t *pstContrast = (MI_ISP_IQ_ContrastType_t *)pIspBuffer;
  MI_ISP_IQ_GetContrast( Channel, pstContrast);
  MI_ISP_IQ_SetContrast( Channel, pstContrast);
  
  MI_ISP_Free_IQDataBuf(pIspBuffer)
  

• Related APIs

  MI_ISP_Free_IQDataBuf.

2.16. MI_ISP_Free_IQDataBuf

• Description

  Release IQ data buffer.

• Syntax

  MI_S32 MI_ISP_Free_IQDataBuf(void *pUserBuf);
  

• Parameter

  Parameter name	Description	Input/Output
  pUserBuf	IQ request data buffer pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Example

  See the example of MI_ISP_Alloc_IQDataBuf.

2.17. MI_ISP_CallBackTask_Register

• Description

  Register ISP callback interface.

• Syntax

  MI_S32 MI_ISP_CallBackTask_Register(MI_ISP_DEV DevId, MI_ISP_CallBackParam_t *pstCallBackParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  pstCallBackParam	ISP callback parameter	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • The interface currently only supports calling by kernel mode.

  • Called in pair with MI_ISP_CallBackTask_Unregister.

• Example

  MI_S32 _MI_ISP_vsync1(MI_U64 u64Data)
  {
      DBG_ERR("DATA %llu \n", u64Data);
      return 0;
  }
  
  MI_S32 _MI_ISP_vsync2(MI_U64 u64Data)
  {
      DBG_ERR("DATA %llu \n", u64Data);
      return 0;
  }
  
  static MS_S32 _MI_ISP_testRegCallback(void)
  {
      MI_ISP_CallBackParam_t stCallBackParam1;
      MI_ISP_CallBackParam_t stCallBackParam2;
      memset(&stCallBackParam1, 0x0, sizeof(MI_ISP_CallBackParam_t));
      memset(&stCallBackParam2, 0x0, sizeof(MI_ISP_CallBackParam_t));
      stCallBackParam1.eCallBackMode = E_MI_ISP _CALLBACK_ISR;
      stCallBackParam1. eIrqType = E_MI_ISP_IRQ_ISPVSYNC;
      stCallBackParam1.pfnCallBackFunc = _mi_ISP_vsync1;
      stCallBackParam1.u64Data = 12;
      MI_ISP_CallBackTask_Register(&stCallBackParam1);
      stCallBackParam2.eCallBackMode = E_MI_ISP_CALLBACK_ISR;
      stCallBackParam2. eIrqType = E_MI_ISP_IRQ_ISPVSYNC;
      stCallBackParam2.pfnCallBackFunc = _mi_ISP_vsync2;
      stCallBackParam2.u64Data = 23;
      MI_ISP_CallBackTask_Register(&stCallBackParam2);
      return 0;
  }
  
  static MS_S32 _MI_ISP_testUnRegCallback(void)
  {
      MI_ISP_CallBackParam_t stCallBackParam1;
      MI_ISP_CallBackParam_t stCallBackParam2;
      memset(&stCallBackParam1, 0x0, sizeof(MI_ISP_CallBackParam_t));
      memset(&stCallBackParam2, 0x0, sizeof(MI_ISP_CallBackParam_t));
      stCallBackParam1.eCallBackMode = E_MI_ISP_CALLBACK_ISR;
      stCallBackParam1.eIrqType = E_MI_ISP_IRQ_ISPVSYNC;
      stCallBackParam1.pfnCallBackFunc = _mi_ISP_vsync1;
      stCallBackParam1.u64Data = 12;
      MI_ISP_CallBackTask_Unregister(&stCallBackParam1);
      stCallBackParam2.eCallBackMode = E_MI_ISP_CALLBACK_ISR;
      stCallBackParam2.eIrqType = E_MI_ISP_IRQ_ISPVSYNC;
      stCallBackParam2.pfnCallBackFunc = _mi_ISP_vsync2;
      stCallBackParam2.u64Data = 23;
      MI_ISP_CallBackTask_Unregister(&stCallBackParam2);
      return 0;
  }
  

• Related APIs

  MI_ISP_CallBackTask_Unregister

2.18. MI_ISP_CallBackTask_Unregister

• Description

  Unregister ISP callback interface

• Syntax

  MI_S32 MI_ISP_CallBackTask_Unregister(MI_ISP_DEV DevId, MI_ISP_CallBackParam_t *pstCallBackParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  pstCallBackParam	ISP callback parameter	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • The interface currently only supports calling by kernel mode.

  • Called in pair of MI_ISP_CallBackTask_Register.

• Example

  See the example of MI_ISP_CallBackTask_Register

2.19. MI_ISP_SkipFrame

• Description

  Set to skip Frame count from calling this API.

• Syntax

  MI_S32 MI_ISP_SkipFrame(MI_ISP_DEV DevId,MI_ISP_CHANNEL ChnId, MI_U32 u32FrameNum);
  

• Parameter

  Parameter name	Description	Input/Output
  ChnId	ISP channel ID	Input
  u32FrameNum	Frame number	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.20. MI_ISP_LoadPortZoomTable

• Description

  Load ISP port Zoom Table.

• Syntax

  MI_S32 MI_ISP_LoadPortZoomTable(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ZoomTable_t *pZoomTable);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pZoomTable	Zoom Table parameter	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • Load zoom table through the interface in advance, each frame applies the zoom parameters in the table in turn to ensure smooth zoom effects.

  • Call MI_ISP_SetOutputPortParam cyclically to set crop, which cannot guarantee the effective setting of each frame and cannot achieve smooth effect.

    X0	Y0	W0	H0	SensorId=0
    X1	Y1	W1	H1	SensorId=0
    X2	Y2	W2	H2	SensorId=1
    X3	Y3	W3	H3	SensorId=1

    The table contains crop position and corresponding sensorid information, sensorid information supports long and short focus switching scenes.

  • The zoom function is completed by the cooperation of MI_ISP and MI_SCL. MI_ISP is responsible for the 3A effect and the long and short focus switching scenes during the zoom process to notify the sensor driver to switch the sensor. MI_SCL is responsible for cropping and scaling up, so in the zoom scene, MI_SCL can no longer use the crop function.

  • During the operation of Zoom, you cannot load the table repeatedly, please use MI_ISP_StopPortZoom first, and then load table.

2.21. MI_ISP_StartPortZoom

• Description

  Start ISP port Zoom.

• Syntax

  MI_S32 MI_ISP_StartPortZoom(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ZoomAttr_t *pstZoomAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstZoomAttr	Zoom Table parameter	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  X0	Y0	W0	H0	SensorId=0
  X1	Y1	W1	H1	SensorId=0
  X2	Y2	W2	H2	SensorId=1
  X3	Y3	W3	H3	SensorId=1

  • u32FromEntryIndex and u32ToEntryIndex are any one of index 0~3 in the table.

  • When u32FromEntryIndex != u32ToEntryIndex, apply crop parameters from u32FromEntryIndex to u32ToEntryIndex frame by frame.

  • When u32FromEntryIndex == u32ToEntryIndex, it will stop at the current u32FromEntryIndex parameter.

  • When MI detects that the sensorid of the next entry is inconsistent with the current sensor id, the sensor driver will be notified of the sensor driver after the current frame is finished, and switch to the corresponding sensor.

• Related APIs

  MI_ISP_StopPortZoom

2.22. MI_ISP_StopPortZoom

• Description

  Stop ISP port Zoom.

• Syntax

  MI_S32 MI_ISP_StopPortZoom(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  Called in pair with MI_ISP_StartPortZoom.

2.23. MI_ISP_GetPortCurZoomAttr

• Description

  Get ISP port current Zoom attribute.

• Syntax

  MI_S32 MI_ISP_GetPortCurZoomAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_ZoomAttr_t *pstZoomAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstZoomAttr	Zoom attribute	output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.24. MI_ISP_GetSubChnId

• Description

  Get ISP subchannel ID

• Syntax

  MI_S32 MI_ISP_GetSubChnId(MI_ISP_DEV DevId, MI_ISP_CHANNEL MainChnId,
  MI_ISP_BindSnrId_e eSensorBindId, MI_U32 *pu32SubChnId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  MainChnId	ISP channel ID	Input
  eSensorBindId	Sensor ID of subchannel binding	Input
  pu32SubChnId	ISP subchannel ID	Output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • In the scene of Stitch, an MI_ISP channel will bind multiple sensors, when IQ wants to control the corresponding sensors, you need to input MI_ISP dev ID, MI_ISP channel ID and sensor ID to get the corresponding subchannel ID, that is, the channel used by IQ.

  • In other cases, the channel used by IQ is the same as MI_ISP channel ID.

2.25. MI_ISP_SetSubChnParam

• Description

  Set ISP subchannel parameter.

• Syntax

  MI_S32 MI_ISP_SetSubChnParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId,
  MI_ISP_SUB_CHANNEL SubChnId, MI_ISP_ChnParam_t *pstChnParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  MainChnId	ISP channel ID	Input
  SubChnId	ISP subchannel ID	Input
  pstChnParam	ISP subchannel parameter pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • It is recommended to switch the sub channel parameters when the channel is stopped to avoid mismatch between the buffer and back-end parameters in the channel, which may cause an exception.

  • Make sure width/height of input and output to be the same between sub channels when setting eRot. E_MI_SYS_ROTATE_90/ E_MI_SYS_ROTATE_270, or E_MI_SYS_ROTATE_NONE/ E_MI_SYS_ROTATE_180.

2.26. MI_ISP_GetSubChnParam

• Description

  Get ISP subchannel parameter.

• Syntax

  MI_S32 MI_ISP_GetSubChnParam(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId,
  MI_ISP_SUB_CHANNEL SubChnId, MI_ISP_ChnParam_t *pstChnParam);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  MainChnId	ISP channel ID	Input
  SubChnId	ISP sub channel ID	Input
  pstChnParam	ISP sub channel parameter pointer	Output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.27. MI_ISP_SetChnOverlapAttr

• Description

  Set ISP channel overlap attribute

• Syntax

  MI_S32 MI_ISP_SetChnOverlapAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId,
  MI_ISP_Overlap_e eOverlap);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID	Input
  ChnId	ISP channel ID	Input
  eOverlap	overlap	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

• Note

  • Overlay is used to merge left and right of image smoothly.

  • Overlay can only take effect when parameter DevId = MI_ISP_CREATE_MULTI_DEV(MI_ISP_DEV0) in calling MI_ISP_CreateDevice, and value of parameter pstChAttr->u32SensorBindId is one sensor in calling MI_ISP_CreateChannel.

  • E_MI_ISP_OVERLAP_128 will read more 128 pixels. E_MI_ISP_OVERLAP_256 will read more 256 pixels.

  • When eOverlap = E_MI_ISP_OVERLAP_256, run as below.

    

2.28. MI_ISP_GetChnOverlapAttr

• Description

  Get ISP channel overlap attribute

• Syntax

  MI_S32 MI_ISP_GetChnOverlapAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId,
  MI_ISP_Overlap_e *peOverlap);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  peOverlap	overlap	Output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.29. MI_ISP_SetLdcAttr

• Description

  Set ISP 1D-LDC attribute.

• Syntax

  MI_S32 MI_ISP_SetLdcAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_LdcAttr_t *pstLdcAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstLdcAttr	1D-LDC attribute	Input

• Return value

  • MI_SUCCESS（0） successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a

2.30. MI_ISP_AiIspInit

• Function

  Initialize AI ISP

• Syntax

  MI_S32 MI_ISP_AiIspInit(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  • Make sure the ISP device is enabled before calling.

• Example

  AI BNR initialization:

  ...
  stGroupAttr.stMetaDataAttr.u32MetaDataTypeMask       = E_MI_VIF_METADATA_AE_STAT | E_MI_VIF_METADATA_AF_STAT;
  stGroupAttr.stAiIspAttr.stVifAiBnrAttr.eAiSourceType = E_MI_VIF_AI_BNR_SOURCE_TYPE_LINEAR;
  stGroupAttr.stAiIspAttr.stVifAiHdrAttr.bAiHdrEn      = FALSE;
  STCHECKRESULT(MI_VIF_CreateDevGroup(groupId, &stGroupAttr));
  ...
  
  ...
  MI_ISP_SetChnParam(IspDevId, IspChnId, &stChnParam);
  
  MI_ISP_AiBnrAttr_t stAiBnrAttr = {0};
  MI_ISP_AiBnrModelParam_t stAiBnrModelParam = {0};
  stAiBnrAttr.eAiSourceType = E_MI_ISP_AI_BNR_SOURCE_TYPE_LINEAR;
  stAiBnrModelParam.u8ModelPath = "/customer/XXX.img";
  
  if(MI_SUCCESS != MI_ISP_AiIspInit(IspDevId, IspChnId))
  {
      printf("AI ISP init failed!\n");
  }
  
  if(MI_SUCCESS != MI_ISP_LoadAiBnrModel(IspDevId, IspChnId, &stAiBnrModelParam, &stAiBnrAttr.u32ModelId))
  {
      printf("AI ISP load model failed!\n");
  }
  printf("model id: 0x%x\n", stAiBnrAttr.u32ModelId);
  
  if(MI_SUCCESS != MI_ISP_SetAiBnrAttr(IspDevId,IspChnId,&stAiBnrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  
  MI_ISP_StartChannel(IspDevId, IspChnId);
  ...
  

  AI BNR deinitialization:

  ...
  MI_ISP_StopChannel(IspDevId, IspChnId);
  MI_ISP_AiBnrAttr_t stAiBnrAttr {0};
  
  if(MI_SUCCESS != MI_ISP_GetAiBnrAttr(IspDevId,IspChnId,&stAiBnrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  stAiBnrAttr.eAiSourceType = E_MI_ISP_AI_BNR_SOURCE_TYPE_NONE;
  
  if(MI_SUCCESS != MI_ISP_SetAiBnrAttr(IspDevId,IspChnId,&stAiBnrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  
  if(MI_SUCCESS != MI_ISP_UnloadAiBnrModel(IspDevId, IspChnId, stAiBnrAttr.u32ModelId))
  {
      printf("AI ISP unload model failed!\n");
  }
  
  if(MI_SUCCESS != MI_ISP_AiIspDeinit(IspDevId, IspChnId))
  {
      printf("AI ISP deinit failed!\n");
  }
  MI_ISP_DestroyChannel(IspDevId, IspChnId);
  ...
  

• Related Topics

  MI_ISP_AiIspDeinit

2.31. MI_ISP_AiIspDeinit

• Function

  Deinitialize AI ISP.

• Syntax

  MI_S32 MI_ISP_AiIspDeinit(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId);

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  You need to stop the channel first, then uninstall the model, and set the AI BNR source to NONE to deinitialize the AI ISP.

2.32. MI_ISP_SetAiBnrAttr

• Function

  Configure the AI BNR.

• Syntax

  MI_S32 MI_ISP_SetAiBnrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiBnrAttr_t *pstAiBnrAttr)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstAiBnrAttr	ISP input port AI BNR parameter configuration pointer.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Example

  Refer to example in MI_ISP_AiIspInit.

2.33. MI_ISP_GetAiBnrAttr

• Function

  Get the configuration of AI BNR.

• Syntax

  MI_S32 MI_ISP_GetAiBnrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiBnrAttr_t *pstAiBnrAttr)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstAiBnrAttr	ISP output port AI BNR parameter configuration pointer.	Output

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

2.34. MI_ISP_LoadAiBnrModel

• Function

  Load the model required by IPU.

• Syntax

  MI_S32 MI_ISP_LoadAiBnrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiBnrModelParam_t *pstModelParam, MI_U32 *pu32ModelId)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstModelParam	Pointer to AI BNR model configuration parameter.	Input
  pu32ModelId	AI BNR model id handle.	Output

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  • The loaded model must match the AI BNR source. Currently, the AI BNR linear and HDR long models can be used interchangeably, but the HDR fusion and the previous two models cannot be used interchangeably.
  • Supports loading multiple models of the same Ai Source. When switching, call MI_ISP_SetAiBnrAttr to set the model id to the model id of the target model.

2.35. MI_ISP_UnloadAiBnrModel

• Function

  Unload the previously loaded model

• Syntax

  MI_S32 MI_ISP_UnloadAiBnrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_U32 u32ModelId)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  u32ModelId	Specify the model id to uninstall.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  • The model to be uninstalled cannot be the model in use. If you uninstall a model in use, Error (E_MI_ERR_BUSY) will be returned. If you want to uninstall a model in use, you must switch models or close AiBnr first.

2.36. MI_ISP_SetAiWdrAttr

• Function

  Configure the AI WDR.

• Syntax

  MI_S32 MI_ISP_SetAiWdrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiWdrAttr_t *pstAiWdrAttr)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstAiWdrAttr	ISP input port AI WDR parameter configuration pointer.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Example

  AI WDR initialization:

  ...
  MI_ISP_SetChnParam(IspDevId, IspChnId, &stChnParam);
  
  MI_ISP_AiWdrAttr_t stAiWdrAttr = {0};
  MI_ISP_AiWdrModelParam_t stAiWdrModelParam = {0};
  stAiWdrAttr.u32AiWdrType = E_MI_ISP_AI_WDR_TYPE_LOCAL;
  stAiWdrModelParam.u8ModelPath = "/customer/XXX.img";
  stAiWdrModelParam.eAiWdrType = E_MI_ISP_AI_WDR_TYPE_LOCAL;
  
  if(MI_SUCCESS != MI_ISP_LoadAiWdrModel(IspDevId, IspChnId, &stAiWdrModelParam, &stAiWdrAttr.u32ModelId))
  {
      printf("AI ISP load model failed!\n");
  }
  printf("model id: 0x%x\n", stAiWdrAttr.u32ModelId);
  
  if(MI_SUCCESS != MI_ISP_SetAiWdrAttr(IspDevId,IspChnId,&stAiWdrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  
  MI_ISP_StartChannel(IspDevId, IspChnId);
  ...
  

  AI WDR deinitialization:

  ...
  MI_ISP_StopChannel(IspDevId, IspChnId);
  MI_ISP_AiWdrAttr_t stAiWdrAttr = {0};
  
  if(MI_SUCCESS != MI_ISP_GetAiWdrAttr(IspDevId,IspChnId,&stAiWdrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  stAiWdrAttr.u32AiWdrType = E_MI_ISP_AI_WDR_TYPE_NONE;
  
  if(MI_SUCCESS != MI_ISP_SetAiWdrAttr(IspDevId,IspChnId,&stAiWdrAttr))
  {
      printf("AI ISP set attr failed!\n");
  }
  
  if(MI_SUCCESS != MI_ISP_UnloadAiWdrModel(IspDevId, IspChnId, stAiWdrAttr.u32ModelId))
  {
      printf("AI ISP unload model failed!\n");
  }
  
  MI_ISP_DestroyChannel(IspDevId, IspChnId);
  ...
  

2.37. MI_ISP_GetAiWdrAttr

• Function

  Get the configuration of AI WDR.

• Syntax

  MI_S32 MI_ISP_GetAiWdrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiWdrAttr_t *pstAiWdrAttr)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstAiWdrAttr	ISP output port AI WDR parameter configuration pointer.	Output

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Example

  Refer to example in MI_ISP_SetAiWdrAttr .

2.38. MI_ISP_LoadAiWdrModel

• Function

  Load the AI WDR model required by IPU.

• Syntax

  MI_S32 MI_ISP_LoadAiWdrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_AiWdrModelParam_t *pstModelParam, MI_U32 *pu32ModelId)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  pstModelParam	Pointer to AI WDR model configuration parameter.	Input
  pu32ModelId	AI WDR model id handle.	Output

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  • The loaded model must match the AI WDR mode.
  • Not supports loading multiple models and dynamic model switching .

• Example

  Refer to example in MI_ISP_SetAiWdrAttr .

2.39. MI_ISP_UnloadAiWdrModel

• Function

  Unload the previously loaded AI WDR model

• Syntax

  MI_S32 MI_ISP_UnloadAiWdrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_U32 u32ModelId)

• Parameter

  Parameter Name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel number.	Input
  u32ModelId	Specify the model id to uninstall.	Input

• Return Value

  • MI_SUCCESS (0): Successful.

  • Non-zero: Failed, see error code for details.

• Dependency

  • Header files: mi_isp_datatype.h, mi_isp.h

  • Library file: libmi_isp.a

• Note

  • The model to be uninstalled cannot be the model in use. If you uninstall a model in use, Error (E_MI_ERR_BUSY) will be returned. If you want to uninstall a model in use, you must close AI WDR first.

• Example

  Refer to example in MI_ISP_SetAiWdrAttr.

2.40. MI_ISP_SetAi3dnrAttr

• Description

  Set AI 3dnr attribute.

• Syntax

  MI_S32 MI_ISP_SetAi3dnrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_Ai3dnrAttr_t *pstAi3dnrAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstAi3dnrAttr	Ai 3dnr attribute pointer	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a, libmi_ipu.a

• Note

  • This function only support linear mode, not support hdr mode.

• Example

  Init：

  ...
  MI_ISP_SetChnParam(IspDevId, IspChnId, &stChnParam);
  MI_ISP_Ai3dnrModelParam_t stAi3dnrModelParam;
  MI_ISP_Ai3dnrAttr_t stAi3dnrAttr;
  
  stAi3dnrModelParam.u8ModelPath = model_path;
  stAi3dnrModelParam.bUpdate = TRUE;
  
  stAi3dnrAttr.bEnable = TRUE;
  
  MI_ISP_AiIspInit(IspDevId, IspChnId);
  MI_ISP_LoadAi3dnrModel(IspDevId, IspChnId, &stAi3dnrModelParam, &stAi3dnrAttr.u32ModelId);
  MI_ISP_SetAiBnrAttr(IspDevId,IspChnId, &stAiBnrAttr);
  MI_ISP_StartChannel(IspDevId, IspChnId);
  ...
  

  Deinit：

  ...
  MI_ISP_StopChannel(IspDevId, IspChnId);
  MI_ISP_Ai3dnrAttr_t stAi3dnrAttr;
  
  MI_ISP_UnloadAi3dnrModel(IspDevId, IspChnId, stAi3dnrAttr.u32ModelId);
  MI_ISP_AiIspDeinit(IspDevId, IspChnId);
  MI_ISP_DestroyChannel(IspDevId, IspChnId);
  ...
  

2.41. MI_ISP_GetAi3dnrAttr

• Description

  Get AI 3dnr attribute.

• Syntax

  MI_S32 MI_ISP_GetAi3dnrAttr(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_Ai3dnrAttr_t *pstAi3dnrAttr);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstAi3dnrAttr	Ai 3dnr attribute pointer	Output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a, libmi_ipu.a

• Note

  • This function only support linear mode, not support hdr mode.

2.42. MI_ISP_LoadAi3dnrModel

• Description

  Load AI 3dnr model.

• Syntax

  MI_S32 MI_ISP_LoadAi3dnrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_ISP_Ai3dnrModelParam_t *pstModelParam, MI_U32 *pu32ModelId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  pstModelParam	Ai model parameter	Input
  pu32ModelId	model ID	Output

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a, libmi_ipu.a

• Note

  • Isp input resolution depend on AI 3dnr model.

  • Isp input pixel format depend on AI 3dnr model.

  • Thip api could not be executed repeatedly, before switching to next model, user should call MI_ISP_UnloadAi3dnrModel to unload last model.

2.43. MI_ISP_UnloadAi3dnrModel

• Description

  Unload AI 3dnr model.

• Syntax

  MI_S32 MI_ISP_UnloadAi3dnrModel(MI_ISP_DEV DevId, MI_ISP_CHANNEL ChnId, MI_U32 u32ModelId);
  

• Parameter

  Parameter name	Description	Input/Output
  DevId	ISP device ID.	Input
  ChnId	ISP channel ID	Input
  u32ModelId	model ID	Input

• Return value

  • MI_SUCCESS (0) successful.

  • Non-Zero: failed, see error code for details.

• Dependence

  • Header: mi_isp_datatype.h, mi_isp.h

  • Library: libmi_isp.a, libmi_ipu.a

3. ISP Data type

Video input related data type definition is as following:

Data type	Description
MI_ISP_DEV	Define ISP device type
MI_ISP_CHANNEL	Define ISP channel type
MI_ISP_PORT	Define ISP port type
MI_ISP_DevMaskId_e	Define the device ID used by the mask for the ISP device
MI_ISP_DevAttr_t	Define ISP device attribute parameter
MI_ISP_HDRType_e	Define HDR switch mode
MI_ISP_3DNR_Level_e	Define 3DNR setting level
MI_ISP_BindSnrId_e	Define the sensor ID bound to the ISP
MI_ISP_SYNC3A_e	Synchronize 3A parameters of each channel
MI_ISP_IQApiHeader_t	Define IQ api data type
MI_ISP_VersionPara_t	Define ISP special parameter version
MI_ISP_CustIQParam_t	Define ISP initialization parameter
MI_ISP_ChannelAttr_t	Define ISP channel static attribute parameter
MI_ISP_ChnParam_t	Define ISP channel dynamic attribute parameter
MI_ISP_OutPortParam_t	Define ISP output port parameter
MI_ISP_CALLBK_FUNC	Define callback function type
MI_ISP_CallBackMode_e	Define callback mode
MI_ISP_IrqType_e	Define hardware interrupt type
MI_ISP_CallBackParam_t	Define callback parameter
MI_ISP_ZoomEntry_t	Define the Zoom cell entry type
MI_ISP_ZoomTable_t	Define Zoom Table type
MI_ISP_ZoomAttr_t	Define Zoom attribute
MI_ISP_BufferLayout_e	ISP buffer layout
MI_ISP_Overlap_e	ISP overlap.
MI_ISP_HDRExposureType_e	Define HDR Exposure Type
MI_ISP_HDRFusionType_e	Define HDR Fusion Type
MI_ISP_LdcAttr_t	Define 1D-LDC attribute
MI_ISP_AiBnrSourceType_e	Define AI BNR sampling location
MI_ISP_AiBnrAttr_t	Define AI BNR attribute parameter
MI_ISP_AiBnrModelParam_t	Define ISP AI BNR model parameter
MI_ISP_AiWdrAttr_t	Define AI WDR parameter
MI_ISP_AiWdrType_e	Define AI WDR type
MI_ISP_AiWdrModelParam_t	Define AI WDR model parameter
MI_ISP_Ai3dnrAttr_t	Define AI 3dnr attribute parameter
MI_ISP_Ai3dnrModelParam_t	Define AI 3dnr model parameter

3.1. MI_ISP_DEV

• Description

  Define ISP device type.

• Definition

  typedef MI_U32 MI_ISP_DEV;
  

3.2. MI_ISP_CHANNEL

• Description

  Define ISP channel type.

• Definition

  typedef MI_U32 MI_ISP_CHANNEL;
  

3.3. MI_ISP_PORT

• Description

  Define ISP port type.

• Definition

  typedef MI_U32 MI_ISP_PORT;
  

3.4. MI_ISP_DevMaskId_e

• Description

  Define the device ID used by the mask for the ISP device.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_DEVICEMASK_ID0 = 0x0001,
  ​     E_MI_ISP_DEVICEMASK_ID1 = 0x0002,
  ​     E_MI_ISP_DEVICEMASK_ID_MAX = 0xffff
  } MI_ISP_DevMaskId_e;
  

• Note

  Tiramisu, Mochi, Maruko, Souffle , Pcupid , Iford , Ifackel and Ifliegen only use ISP E_MI_ISP_DEVICEMASK_ID0.

• Related data type and interface

  MI_ISP_CreateDevice

3.5. MI_ISP_DevAttr_t

• Description

  Define ISP device attribute parameter.

• Definition

  typedef struct MI_ISP_DevAttr_s
  {
  ​     MI_U32  u32DevStitchMask; //multi ISP dev bitmask by MI_ISP_DevMaskId_e
  }MI_ISP_DevAttr_t;
  

• Member

  Member name	Description
  u32DevStitchMask	ISP DEV ID mask.

• Note

  u32DevStitchMask is composed of MI_ISP_DevMaskId_e and bitmask. If the processing speed of an isp device on the channel cannot meet the requirements, you can use this parameter to reuse another Device, but another device can no longer be created.

• Related data type and interface

  MI_ISP_CreateDevice

3.6. MI_ISP_HDRType_e

• Description

  Define HDR switch mode.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_HDR_TYPE_OFF,
  ​     E_MI_ISP_HDR_TYPE_VC,
  ​     E_MI_ISP_HDR_TYPE_DOL,
  ​     E_MI_ISP_HDR_TYPE_COMP,
  ​     E_MI_ISP_HDR_TYPE_LI,
  ​     E_MI_ISP_HDR_TYPE_COMPVS,
  ​     E_MI_ISP_HDR_TYPE_DCG,
  ​     E_MI_ISP_HDR_TYPE_MAX
  } MI_ISP_HDRType_e;
  

• Member

  Member name	Description
  E_MI_ISP_HDR_TYPE_OFF	Turn off HDR
  E_MI_ISP_HDR_TYPE_VC	virtual channel mode HDR, vc0->long,vc1->short
  E_MI_ISP_HDR_TYPE_DOL	Digital Overlap High Dynamic Range
  E_MI_ISP_HDR_TYPE_COMP	Long and Short exposure are merged by sesnor, and isp controls the gain vaule of two frames
  E_MI_ISP_HDR_TYPE_LI	Line interlace HDR
  E_MI_ISP_HDR_TYPE_COMPVS	compressed HDR + Very short
  E_MI_ISP_HDR_TYPE_DCG	Dual conversion gain HDR
  E_MI_ISP_HDR_TYPE_MAX	HDR boundary value

• Note

  • The HDR Type used can be obtained through the MI_SNR_GetPadInfo interface.

  • The HDR function requires the cooperation of MI_VIF and MI_ISP modules, and the same HDR type needs to be set on both sides.

  • E_MI_ISP_HDR_TYPE_DCG and E_MI_ISP_HDR_TYPE_COMPVS are temporarily not supported.

  • Opera series chip support E_MI_ISP_HDR_TYPE_COMP.

• Related data type and interface

  MI_ISP_ChnParam_t

3.7. MI_ISP_3DNR_Level_e

• Description

  Define 3DNR setting level.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_3DNR_LEVEL_OFF,
  ​     E_MI_ISP_3DNR_LEVEL1,
  ​     E_MI_ISP_3DNR_LEVEL2,
  ​     E_MI_ISP_3DNR_LEVEL3,
  ​     E_MI_ISP_3DNR_LEVEL4,
  ​     E_MI_ISP_3DNR_LEVEL5,
  ​     E_MI_ISP_3DNR_LEVEL6,
  ​     E_MI_ISP_3DNR_LEVEL7,
  ​     E_MI_ISP_3DNR_LEVEL_NUM
  }MI_ISP_3DNR_Level_e;
  

• Note

  The higher the level, the better the noise reduction effect and the more buffer consumed.

  Chip	3DNR support max level
  Tiramisu	E_MI_ISP_3DNR_LEVEL2
  Muffin	E_MI_ISP_3DNR_LEVEL2
  Mochi	E_MI_ISP_3DNR_LEVEL7
  Maruko	E_MI_ISP_3DNR_LEVEL7
  Souffle	E_MI_ISP_3DNR_LEVEL5
  Pcupid	E_MI_ISP_3DNR_LEVEL2
  Iford	E_MI_ISP_3DNR_LEVEL6
  Ifackel	E_MI_ISP_3DNR_LEVEL5
  Ifliegen	E_MI_ISP_3DNR_LEVEL5

• Related data type and interface

  MI_ISP_ChnParam_t

3.8. MI_ISP_BindSnrId_e

• Description

  Define the sensor ID bound to the ISP.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_SENSOR_INVALID = 0,
  ​     E_MI_ISP_SENSOR0 = 0x1,
  ​     E_MI_ISP_SENSOR1 = 0x2,
  ​     E_MI_ISP_SENSOR2 = 0x4,
  ​     E_MI_ISP_SENSOR3 = 0x8,
  ​     E_MI_ISP_SENSOR4 = 0x10,
  ​     E_MI_ISP_SENSOR5 = 0x20,
  ​     E_MI_ISP_SENSOR6 = 0x40,
  ​     E_MI_ISP_SENSOR7 = 0x80,
  ​     E_MI_ISP_SENSOR_MAX = 8
  }MI_ISP_BindSnrId_e;
  

3.9. MI_ISP_SYNC3A_e

• Description

  Synchronize 3A parameters of each channel.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_SYNC3A_NONE = 0x00,
  ​     E_MI_ISP_SYNC3A_AE   = 0x01,
  ​     E_MI_ISP_SYNC3A_AWB  = 0x02,
  ​     E_MI_ISP_SYNC3A_IQ           = 0x04,
  ​     E_MI_ISP_SYNC3A_1ST_SNR_ONLY = 0x10
  }MI_ISP_SYNC3A_e;
  

• Member

  Member name	Description
  E_MI_ISP_SYNC3A_NONE	Async 3A
  E_MI_ISP_SYNC3A_AE	Sync AE
  E_MI_ISP_SYNC3A_AWB	Sync AWB
  E_MI_ISP_SYNC3A_IQ	Sync IQ parameter setting
  E_MI_ISP_SYNC3A_1ST_SNR_ONLY	Only control 1st sensor

3.10. MI_ISP_IQApiHeader_t

• Description

  Define IQ api data type.

• Definition

  typedef struct MI_ISP_IQApiHeader_s
  {
  ​     MI_U32 u32HeadSize;    //Size of MIIspApiHeader_t
  ​     MI_U32 u32DataLen;     //Data length;
  ​     MI_U32 u32CtrlID;      //Function ID
  ​     MI_U32 u32Channel;     //Isp channel number
  ​     MI_U32 u32DevId;       //Isp Device Id
  ​     MI_S32 s32Ret;         //Isp api retuen value
  } MI_ISP_IQApiHeader_t;
  

• Member

  Member name	Description
  u32HeadSize	MI_ISP_IQApiHeader_t struct takes up space
  u32DataLen	Data size
  u32CtrlID	Function corresponding control Id
  u32Channel	Isp channel Id
  u32DevId	Isp device Id
  s32Ret	Interface return value

3.11. MI_ISP_VersionPara_t

• Description

  Define ISP special parameter version.

• Definition

  typedef struct MI_ISP_VersionPara_s
  {
  ​     MI_U32 u32Revision;
  ​     MI_U32 u32Size;
  ​     MI_U8 u8Data[VERSIONPARA_DATA_SIZE];
  }MI_ISP_VersionPara_t;
  

• Member

  Member name	Description
  u32Revision	Negotiate with IQ team to define the corresponding version number
  u32Size	Data corresponds to effective size
  u8Data[VERSIONPARA_DATA_SIZE]	Store data, the value of VERSIONPARA_DATA_SIZE is 64

• Related data type and interface

  MI_ISP_CustIQParam_t

3.12. MI_ISP_CustIQParam_t

• Description

  Define ISP initialization parameter.

• Definition

  typedef struct MI_ISP_CustIQParam_s
  {
  ​     MI_ISP_VersionPara_t  stVersion;
  }MI_ISP_CustIQParam_t;
  

• Member

  Member name	Description
  stVersion	Version parameter

• Note

  Some IQ initialization parameters that require ISP customized processing can be set through this parameter. If there is no requirement, you can set all of them to 0.

3.13. MI_ISP_ChannelAttr_t

• Description

  Define ISP channel static attribute parameter.

• Definition

  typedef struct MI_ISP_ChannelAttr_s
  {
  ​     MI_U32  u32SensorBindId; //bitmask by MI_ISP_BindSnrId_e
  ​     MI_ISP_CustIQParam_t stIspCustIqParam;
  ​     MI_U32  u32Sync3AType; //sync 3a bitmask by MI_ISP_SYNC3A_e
  }MI_ISP_ChannelAttr_t;
  

• Member

  Member name	Description
  u32SensorBindId	Sensor Id corresponding to channel binding
  stIspCustIqParam	Isp IQ initialization parameter
  u32Sync3AType	Sync the 3A/IQ parameters between multiple groups of images in the channel

• Note

  • When a multi-sensor splicing scene, one ISP channel needs to process multiple sensor images, you need to set up multiple sensor Id bitmasks through u32SensorBindId, otherwise only the corresponding sensor Id interface is set. If you do not need ISP to do IQ/3A, or the front-end data source is not sensor, you can set it to 0.

  • When multi-sensor splicing scenes, one ISP channel needs to process multiple sensor images, set the 3A/IQ effect synchronization between multiple images through u32Sync3AType to avoid excessive differences in effects between the two images.

• Related data type and interface

  MI_ISP_CreateChannel

3.14. MI_ISP_ChnParam_t

• Description

  Define ISP channel dynamic attribute parameter.

• Definition

  typedef struct MI_ISP_ChnParam_s
  {
  ​     MI_ISP_HDRType_e       eHDRType;
  ​     MI_ISP_3DNR_Level_e    e3DNRLevel;
  ​     MI_BOOL                bMirror;
  ​     MI_BOOL                bFlip;
  ​     MI_SYS_Rotate_e        eRot;
  ​     MI_BOOL                bY2bEnable;
       MI_BOOL                bLdcEnable;
  ​     MI_ISP_HDRFusionType_e eHDRFusionType;
  ​     MI_U16                 u16HDRExposureMask;
  } MI_ISP_ChnParam_t;
  

• Member

  Member name	Description
  eHDRType	HDR switch parameter
  e3DNRLevel	3dnr lever
  bMirror	Enable channel mirror
  bFlip	Enable channel flip
  eRot	Channel rotation parameter
  bY2bEnable	Enable the conversion function of yuv to bayer
  bLdcEnable	Enable the function ISP-LDC
  eHDRFusionType	HDR Fusion Type
  u16HDRExposureMask	HDR Exposure Type Mask, MI_ISP_HDRExposureType_e Composition

• Note

  • Non Maruko / Souffle / Ifackel / Ifliegen chip, when eRot > 0 or bflip = true, e3dnrlevel must be greater than 0.

  • bY2bEnable is only supported by Muffin and only supported when the input port is Frame Mode.

  • Mochi does not support HDR/Mirror/Flip/Rot/Y2bEnable.

  • ISP eHDRType follows Sensor eHDRType and supports up to 3frame HDR sensor. For this purpose, ISP can control different exposure frame fusion or direct output through the combination of eHDRFusionType and u16HDRExposureMask.

• Example

  ID	Scenario Description
  1	SENSOR 2frame HDR,ISP 2frame HDR
  2	SENSOR 3frame HDR,ISP 2frame HDR
  3	SENSOR 3frame HDR,ISP 3frame HDR
  4	SENSOR 2frame HDR,ISP 2chn Detach export 2frame
  5	SENSOR 3frame HDR,ISP 2chn Detach expor 2frame
  6	SENSOR 3frame HDR,ISP 3chn Detach expor 3frame
  7	SENSOR 3frame HDR,ISP 2chn Detach expor 2frame HDR and 1frame

  Scenario 1：SENSOR 2frame HDR,ISP 2frame HDR 

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_2TO1	xx_FUSION_TYPE_2TO1	LS	xx_FUSION_TYPE_2TO1	LS

  Scenario 2：SENSOR 3frame HDR,ISP 2frame HDR

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_3TO1	xx_FUSION_TYPE_3TO1	LS / LM / MS	xx_FUSION_TYPE_2TO1	LS / LM / MS

  Scenario 3：SENSOR 3frame HDR,ISP 3frame HDR

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_3TO1	xx_FUSION_TYPE_3TO1	LMS	xx_FUSION_TYPE_3TO1	LMS

  Scenario 4：SENSOR 2frame HDR,ISP 2chn Detach export 2frame

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_2TO1	xx_FUSION_TYPE_2TO1	LS	Chn0 xx_FUSION_TYPE_2TO1	Chn0 L / S
  			Chn1 xx_FUSION_TYPE_2TO1	Chn1 S / L

  Scenario 5：SENSOR 3frame HDR,ISP 2chn Detach expor 2frame

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_3TO1	xx_FUSION_TYPE_3TO1	LS / LM / MS	Chn0 xx_FUSION_TYPE_2TO1	Chn0 L / M / S
  			Chn1 xx_FUSION_TYPE_2TO1	Chn1 S / L / M

  Scenario 6：SENSOR 3frame HDR,ISP 3chn Detach expor 3frame

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_3TO1	xx_FUSION_TYPE_3TO1	LMS	Chn0 xx_FUSION_TYPE_3TO1	Chn0 L / M / S
  			Chn1 xx_FUSION_TYPE_3TO1	Chn1 M / S / L
  			Chn2 xx_FUSION_TYPE_3TO1	Chn2 S / L / M

  Scenario 7：SENSOR 3frame HDR,ISP 2chn Detach expor 2frame HDR and 1frame

  Sensor	VIF		ISP
  eHDRFusionType	eHDRFusionType	u16HDRExposureMask	eHDRFusionType	u16HDRExposureMask
  xx_FUSION_TYPE_3TO1	xx_FUSION_TYPE_3TO1	LMS	Chn0 xx_FUSION_TYPE_3TO1	Chn0 LS / LM / MS
  			Chn0 xx_FUSION_TYPE_3TO1	Chn0 M / S / L

• Related data type and interface

  MI_ISP_SetChnParam

  MI_ISP_HDRFusionType_e

  MI_ISP_HDRExposureType_e

3.15. MI_ISP_OutPortParam_t

• Description

  Define ISP output port parameter.

• Definition

  typedef struct MI_ISP_OutPortParam_s
  {
  ​     MI_SYS_WindowRect_t stCropRect;
  ​     MI_SYS_PixelFormat_e  ePixelFormat;
  ​     MI_SYS_CompressMode_e eCompressMode;
  ​     MI_ISP_BufferLayout_e eBufLayout;
  }MI_ISP_OutPortParam_t;
  

• Member

  Member name	Description
  stCropRect	Output crop area
  ePixelFormat	Pixel format
  eCompressMode	Output compress mode
  eBufLayout	Output image buffer layout

• Note

  • eCompressMode support range:

    Chip	Output compress mode supported
    Tiramisu	E_MI_SYS_COMPRESS_MODE_NONE
    Muffin	E_MI_SYS_COMPRESS_MODE_NONE
    Mochi	E_MI_SYS_COMPRESS_MODE_NONE E_MI_SYS_COMPRESS_MODE_TO_6BIT
    Maruko	E_MI_SYS_COMPRESS_MODE_TO_6BIT
    Soufffle	E_MI_SYS_COMPRESS_MODE_NONE E_MI_SYS_COMPRESS_MODE_TO_6BIT
    Pcupid	E_MI_SYS_COMPRESS_MODE_NONE
    Iford	E_MI_SYS_COMPRESS_MODE_NONE

  • E_MI_SYS_COMPRESS_MODE_10TO6 limit

    Output_Compress_10TO6		Mochi	Maruko	Soufffle
    Pixel	yuv420SP NV12	Y	Y	Y
    	yuv422 YUYV	Y	Y	Y
    Pixel Alignment (WxH)	yuv420SP NV12	2x2	2x2	2x2
    	yuv422 YUYV	2x2	2x2	2x2

3.16. MI_ISP_CALLBK_FUNC

• Description

  Define callback function type.

• Definition

  typedef MI_S32 (*MI_ISP_CALLBK_FUNC)(MI_U64 u64Data);
  

• Related data type and interface

  MI_ISP_CallBackParam_t

3.17. MI_ISP_CallBackMode_e

• Description

  Define callback mode.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_CALLBACK_ISR,
  ​     E_MI_ISP_CALLBACK_MAX,
  } MI_ISP_CallBackMode_e;
  

• Member

  Member name	Description
  E_MI_ISP_CALLBACK_ISR	Hardware interrupt mode callback
  E_MI_ISP_CALLBACK_MAX	Maximum value of callback mode

• Note

  Currently only supports ISR callback mode.

• Related data type and interface

  MI_ISP_CallBackParam_t

3.18. MI_ISP_IrqType_e

• Description

  Define hardware interrupt type.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_IRQ_ISPVSYNC,
  ​     E_MI_ISP_IRQ_ISPFRAMEDONE,
  ​     E_MI_ISP_IRQ_MAX,
  } MI_ISP_IrqType_e;
  

• Member

  Member name	Description
  E_MI_ISP_IRQ_ISPVSYNC	ISP Vsync interrupt type
  E_MI_ISP_IRQ_ISPFRAMEDONE	ISP Frame done interrupt type
  E_MI_ISP_IRQ_MAX	ISP hardware interrupt type maximum

• Note

  • E_MI_VPE_IRQ_ISPVSYNC: The signal of the first pixel in each frame.

  • E_MI_VPE_IRQ_ISPFRAMEDONE: The signal at the end of each frame written by isp.

• Related data type and interface

  MI_ISP_CallBackParam_t

3.19. MI_ISP_CallBackParam_t

• Description

  Define callback parameter.

• Definition

  typedef struct MI_ISP_CallBackParam_s
  {
  ​     MI_ISP_CallBackMode_e eCallBackMode;
  ​     MI_ISP_IrqType_e  eIrqType;
  ​     MI_ISP_CALLBK_FUNC  pfnCallBackFunc;
  ​     MI_U64    u64Data;
  } MI_ISP_CallBackParam_t;
  

• Member

  Member name	Description
  eCallBackMode	Callback mode
  eIrqType	Hardware interrupt mode type
  pfnCallBackFunc	Callback interface pointer
  u64Data	Callback interface parameter

• Note

  None.

• Related data type and interface

  MI_ISP_CallBackTask_Register

  MI_ISP_CallBackTask_Unregister

3.20. MI_ISP_ZoomEntry_t

• Description

  Define the Zoom cell entry type.

• Definition

  typedef struct MI_ISP_ZoomEntry_s
  {
  ​     MI_SYS_WindowRect_t stCropWin;
  ​     MI_U8 u8ZoomSensorId;
       MI_SYS_PixelFormat_e eSensorPixFormat;
       MI_SYS_WindowSize_t  stSensorRes;
  } MI_ISP_ZoomEntry_t;
  

• Member

  Member name	Description
  stCropWin	Crop position parameter
  u8ZoomSensorId	The sensor Id corresponding to the Crop parameter
  eSensorPixFormat	sensor output format
  stSensorRes	sensor output resolution

• Note

  u8ZoomSensorId corresponds to the return value of the pCus_sensor_GetCurSwtichSensorId callback function in the sensor driver.

  There are restrictions on configuring eSensorPixFormat and stSensorRes. Currently, only when VIF and ISP are bound in realtime mode is it possible to use sensors with different resolutions. If they are bound in frame mode, sensors with different resolutions are not supported.

  If the width and height of stSensorRes are set to 0, then ignore 'support for different resolution sensors'.

  Here is a piece of simple code to show how these parameter usage:

  2688x1520，RG10BPP,the other:2560x1440，RG10BPP

  u8SnrPadId[2] = {0,1}
  eSensorPixFormat[2] = {32,32}
  stSensorRes[2] = {{0,0,2688,1520},{0,0,2560,1440}}
  pZoomTable->pVirTableAddr[i].u8ZoomSensorId = u8SnrPadId[u8SnrId];
  pZoomTable->pVirTableAddr[i].eSensorPixFormat = eSensorPixFormat[u8SnrId];
  pZoomTable->pVirTableAddr[i].stSensorRes.u16Width = stSensorRes[u8SnrId].u16Width;
  pZoomTable->pVirTableAddr[i].stSensorRes.u16Height = stSensorRes[u8SnrId].u16Height;
  

• Related data type and interface

  MI_ISP_ZoomTable_t

3.21. MI_ISP_ZoomTable_t

• Description

  Define Zoom Table type.

• Definition

  typedef struct MI_ISP_ZoomTable_s
  {
  ​     MI_U32 u32EntryNum;
  ​     MI_ISP_ZoomEntry_t *pVirTableAddr;
  } MI_ISP_ZoomTable_t;
  

• Member

  Member name	Description
  u32EntryNum	Number of entries in the Zoom Table
  pVirTableAddr	Zoom Table Buffer Pointer

• Related data type and interface

  MI_ISP_LoadPortZoomTable

3.22. MI_ISP_ZoomAttr_t

• Description

  Define Zoom attribute.

• Definition

  typedef struct MI_ISP_ZoomAttr_s
  {
  ​     MI_U32 u32FromEntryIndex;
  ​     MI_U32 u32ToEntryIndex;
  ​     MI_U32 u32CurEntryIndex;
  } MI_ISP_ZoomAttr_t;
  

• Member

  Member name	Description
  u32FromEntryIndex	Start to run Zoom entry index
  u32ToEntryIndex	Stop to run Zoom entry index
  u32CurEntryIndex	Index of current Zoom position

• Related data type and interface

  MI_ISP_StartPortZoom

  MI_ISP_GetPortCurZoomAttr

3.23. MI_ISP_BufferLayout_e

• Description

  ISP buffer layout.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_BUFFER_LAYOUT_ONE_FRAME,
  ​     E_MI_ISP_BUFFER_LAYOUT_MULTI_PLANE,
  ​     E_MI_ISP_BUFFER_LAYOUT_MAX,
  } MI_ISP_BufferLayout_e;
  

• Member

  Member name	Description
  E_MI_ISP_BUFFER_LAYOUT_ONE_FRAME	Data layout in one buffer
  E_MI_ISP_BUFFER_LAYOUT_MULTI_PLANE	Data layout in multi buffer
  E_MI_ISP_BUFFER_LAYOUT_MAX	Maximum value

• Note

  • Only in stitch mode, eBufLayout can set E_MI_ISP_BUFFER_LAYOUT_MULTI_PLANE. In this case, buffer type of output port is E_MI_SYS_BUFDATA_MULTIPLANE. Otherwise E_MI_SYS_BUFDATA_FRAME is output.

  • Only output port 1 supports eBufLayout = E_MI_ISP_BUFFER_LAYOUT_MULTI_PLANE.

  • You can look up E_MI_SYS_BUFDATA_MULTIPLANE and E_MI_SYS_BUFDATA_FRAME in MI SYS API.

• Related data type and interface

  MI_ISP_SetOutputPortParam

  MI_ISP_GetOutputPortParam

3.24. MI_ISP_Overlap_e

• Description

  ISP overlap.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_OVERLAP_NONE,
  ​     E_MI_ISP_OVERLAP_128,
  ​     E_MI_ISP_OVERLAP_256,
  ​     E_MI_ISP_OVERLAP_MAX
  } MI_ISP_Overlap_e;
  

• Member

  Member name	Description
  E_MI_ISP_OVERLAP_NONE	Disable overlap
  E_MI_ISP_OVERLAP_128	Read more 128 pixels
  E_MI_ISP_OVERLAP_256	Read more 256 pixels
  E_MI_ISP_OVERLAP_MAX	Maximum value

• Related data type and interface

  MI_ISP_SetChnOverlapAttr

  MI_ISP_GetChnOverlapAttr

3.25. MI_ISP_HDRExposureType_e

• Description

  Define HDR Exposure Type.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_HDR_EXPOSURE_TYPE_NONE,
  ​     E_MI_ISP_HDR_EXPOSURE_TYPE_SHORT  = 0x1,
  ​     E_MI_ISP_HDR_EXPOSURE_TYPE_MEDIUM = 0x2,
  ​     E_MI_ISP_HDR_EXPOSURE_TYPE_LONG   = 0x4,
  ​     E_MI_ISP_HDR_EXPOSURE_TYPE_MAX
  } MI_ISP_HDRExposureType_e;
  

• Member

  Member name	Description
  E_MI_ISP_HDR_EXPOSURE_TYPE_NONE	Disable Exposure Type
  E_MI_ISP_HDR_EXPOSURE_TYPE_SHORT	Short Exposure
  E_MI_ISP_HDR_EXPOSURE_TYPE_MEDIUM	Medium Exposure
  E_MI_ISP_HDR_EXPOSURE_TYPE_LONG	Long Exposure
  E_MI_ISP_HDR_EXPOSURE_TYPE_MAX	MAX Exposure

• Related data type and interface

  MI_ISP_ChnParam_t

  MI_ISP_SetChnParam

3.26. MI_ISP_HDRFusionType_e

• Description

  Define HDR Fusion Type.

• Definition

  typedef enum
  {
  ​     E_MI_ISP_HDR_FUSION_TYPE_NONE,
  ​     E_MI_ISP_HDR_FUSION_TYPE_2TO1,
  ​     E_MI_ISP_HDR_FUSION_TYPE_3TO1,
  ​     E_MI_ISP_HDR_FUSION_TYPE_MAX
  } MI_ISP_HDRFusionType_e;
  

• Member

  Member name	Description
  E_MI_ISP_HDR_FUSION_TYPE_NONE	Disable Fusion Type
  E_MI_ISP_HDR_FUSION_TYPE_2TO1	2-frame fusion HDR
  E_MI_ISP_HDR_FUSION_TYPE_3TO1	3-frame fusion HDR
  E_MI_ISP_HDR_FUSION_TYPE_MAX	MAX Fusion Type

• Related data type and interface

  MI_ISP_ChnParam_t

  MI_ISP_SetChnParam

3.27. MI_ISP_LdcAttr_t

• Description

  Define 1D-LDC attribute.

• Definition

  typedef struct MI_ISP_LdcAttr_s
  {
      MI_U32 u32CenterXOffset;
      MI_U32 u32CenterYOffset;
      MI_S32 s32Alpha;
      MI_S32 s32Beta;
      MI_U32 u32CropLeft;
      MI_U32 u32CropRight;
  } MI_ISP_LdcAttr_t;
  

• Member

  Member name	Description
  u32CenterXOffset	Optical center coordinate u0 [0, 2^15 - 1]
  u32CenterYOffset	Optical center coordinate v0 [0, 2^15 - 1]
  s32Alpha	Distortion correction parameter alpha. The correction effect is more obvisious for images near the distance x=0. The larger the alpha, the greater the correction intensity, which means serious distortion at the center. [-2048, 2047]
  s32Beta	Distortion correction parameter beta. The correction effect is more obvisious for images that are further away from x=0 and closer to the left and right edges of the image. The larger the beta, the greater the correction intensity, which means serious distortion at the edge. [-2048, 2047]
  u32CropLeft	Crop the pixel value on the left side to ensure that there is no black border on the left side after distortion. [0, 2^11 - 1]
  u32CropRight	Crop the pixel value on the right side to ensure that there is no black border on the right side after distortion. [0, 2^11 - 1]

• Related data type and interface

  MI_ISP_SetLdcAttr

3.28. MI_ISP_AiBnrSourceType_e

• Description

  Defines the ISP AIBNR sampling point location.

• Definition

  typedef enum
  {
      E_MI_ISP_AI_BNR_SOURCE_TYPE_NONE,
      E_MI_ISP_AI_BNR_SOURCE_TYPE_LINEAR,
      E_MI_ISP_AI_BNR_SOURCE_TYPE_HDR_FUSION,
      E_MI_ISP_AI_BNR_SOURCE_TYPE_HDR_LONG,
      E_MI_ISP_AI_BNR_SOURCE_TYPE_MAX
  } MI_ISP_AiBnrSourceType_e;
  

• Member

  Member Name	Description
  E_MI_ISP_AI_BNR_SOURCE_TYPE_NONE	Disable AI BNR
  E_MI_ISP_AI_BNR_SOURCE_TYPE_LINEAR	AIBNR linear noise reduction mode
  E_MI_ISP_AI_BNR_SOURCE_TYPE_HDR_FUSION	AI BNR HDR fusion noise reduction mode
  E_MI_ISP_AI_BNR_SOURCE_TYPE_HDR_LONG	AI BNR HDR long exposure noise reduction mode
  E_MI_ISP_AI_BNR_SOURCE_TYPE_MAX	AI BNR source boundary value

• Note

  • AI BNR HDR fusion noise reduction mode and AI BNR HDR long exposure noise reduction mode require the cooperation of HDR and AI ISP modules, and HDR needs to be set to on both sides.

• Related Data Types and Interfaces

  MI_ISP_AiBnrAttr_t

3.29. MI_ISP_AiBnrAttr_t

• Description

  Defines AI BNR configuration parameters.

• Definition

  typedef struct MI_ISP_AiBnrAttr_s
  {
      MI_ISP_AiBnrSourceType_e eAiSourceType;
      MI_U32                   u32ModelId;
  } MI_ISP_AiBnrAttr_t;
  

• Member

  Member Name	Description
  eAiSourceType	ISP AI BNR sampling location.
  u32ModelId	model index identifier.

• Related Data Types and Interfaces

  MI_ISP_SetAiBnrAttr

  MI_ISP_GetAiBnrAttr

3.30. MI_ISP_AiBnrModelParam_t

• Description

  Defines ISP AIBNR model configuration parameters.

• Definition

  typedef struct MI_ISP_AiBnrModelParam_s
  {
      MI_U8   u8ModelPath[MAX_AI_MODEL_PATH_SIZE]; // Model Path
      MI_BOOL bUpdate;                             // FALSE: load model only, TRUE: load and enable new model.
  } MI_ISP_AiBnrModelParam_t;
  

• Member

  Member Name	Description
  u8ModelPath	Model path
  bUpdate	FALSE: only load the model, TRUE: can load the model and make it effective at the same time

• Note

  • When BNR is enabled, if you load a model again, the model must be the same type as the running model. You can make the model effective by specifying bUpdate as True. When BNR is not enabled, bUpdate as True is invalid, and you still need to set the correct Model ID in the parameters of the MI_ISP_SetAiBnrAttr interface.

• Related Data Types and Interfaces

  MI_ISP_LoadAiBnrModel

3.31. MI_ISP_AiWdrAttr_t

• Description

  Defines AI WDR configuration parameters.

• Definition

  typedef struct MI_ISP_AiWdrAttr_s
  {
      MI_U32 u32AiWdrType;
      MI_U32 u32ModelId;
  } MI_ISP_AiWdrAttr_t;
  

• Member

  Member Name	Description
  u32AiWdrType	ISP AI WDR working mode, composed of a bitmask of type MI_ISP_AiWdrType_e
  u32ModelId	model index identifier.

• Related Data Types and Interfaces

  MI_ISP_SetAiWdrAttr

  MI_ISP_GetAiWdrAttr

3.32. MI_ISP_AiWdrType_e

• Description

  Defines ISP AI WDR work mode.

• Definition

  typedef enum
  {
      E_MI_ISP_AI_WDR_TYPE_NONE  = 0x00,
      E_MI_ISP_AI_WDR_TYPE_LOCAL = 0x01,
      E_MI_ISP_AI_WDR_TYPE_MAX   = 0x02,
  } MI_ISP_AiWdrType_e;
  

• Member

  Member Name	Description
  E_MI_ISP_AI_WDR_TYPE_NONE	Disable AI BNR
  E_MI_ISP_AI_WDR_TYPE_LOCAL	AI WDR small background mode
  E_MI_ISP_AI_WDR_TYPE_MAX	AI WDR mode boundary value

• Note

  • The effectiveness of AI WDR requires the cooperation of IQ and AI ISP , and AI WDR needs to be enabled on both sides.

• Related Data Types and Interfaces

  MI_ISP_AiWdrAttr_t

3.33. MI_ISP_AiWdrModelParam_t

• Description

  Defines ISP AI WDR model configuration parameters.

• Definition

  typedef struct MI_ISP_AiWdrModelParam_s
  {
      MI_ISP_AiWdrType_e eAiWdrType;
      MI_U8              u8ModelPath[MAX_AI_MODEL_PATH_SIZE];
      MI_BOOL            bUpdate;
  } MI_ISP_AiWdrModelParam_t;
  

• Member

  Member Name	Description
  MI_ISP_AiWdrType_e	model AI WDR mode
  u8ModelPath	Model path
  bUpdate	FALSE: only load the model, TRUE: can load the model and make it effective at the same time

• Note

  • AI WDR does not support dynamic model switching.

• Related Data Types and Interfaces

  MI_ISP_LoadAiWdrModel

3.34. MI_ISP_Ai3dnrAttr_t

• Description

  Define AI 3dnr attribute parameter.

• Definition

  typedef struct MI_ISP_Ai3dnrAttr_s
  {
      MI_BOOL bEnable;
      MI_U32 u32ModelId;
  } MI_ISP_Ai3dnrAttr_t;
  

• Member

  Member name	Description
  bEnable	AI 3dnr enable
  u32ModelId	AI 3dnr model id

• Related data type and interface

  MI_ISP_SetAi3dnrAttr

3.35. MI_ISP_Ai3dnrModelParam_t

• Description

  Define AI 3dnr model parameter.

• Definition

  typedef struct MI_ISP_Ai3dnrModelParam_s
  {
      MI_U8 u8ModelPath[MAX_AI_MODEL_PATH_SIZE];
      MI_BOOL bUpdate;
  } MI_ISP_Ai3dnrModelParam_t;
  

• Member

  Member name	Description
  u8ModelPath	AI 3dnr model path
  bUpdate	Load model and enable new model

• Related data type and interface

  MI_ISP_LoadAi3dnrModel

4. ISP Error code

API error codes are as the table shown below:

Error code	Macro definition	Description
0xA0078001	MI_ERR_ISP_INVALID_CHNID	Invalid device channel ID
0xA0078002	MI_ERR_ISP_INVALID_PORTID	Invalid device port ID
0xA0078003	MI_ERR_ISP_ILLEGAL_PARAM	Illegal parameter
0xA0078004	MI_ERR_ISP_EXIST	Device has exited
0xA0078005	MI_ERR_ISP_UNEXIST	Device has not exited
0xA0078006	MI_ERR_ISP_NULL_PTR	Null pointer parameter
0xA0078008	MI_ERR_ISP_NOT_SUPPORT	Not supported
0xA0078009	MI_ERR_ISP_NOT_PERM	Operation is not permitted
0xA007800C	MI_ERR_ISP_NOMEM	Failed to allocate memory
0xA007800D	MI_ERR_ISP_NOBUF	Memory has run out
0xA007800E	MI_ERR_ISP_BUF_EMPTY	Video input buffer is empty
0xA0078010	MI_ERR_ISP_NOTREADY	Device is not initialized
0xA0078012	MI_ERR_ISP_BUSY	Device system is busy

5. PROCFS INTRODUCTION

5.1. cat

• Debug info

  # cat /proc/mi_modules/mi_isp/mi_isp0
  

  

• Debug info analysis

  Record the current ISP usage status and related attributes, you can

  get this information dynamically, which is convenient for debugging and testing.

• Parameter Description

  Parameter		Description
  ISP Dev info	DevId	Isp Dev Id
  	CreChnNum	Chn number
  	DevMask	Stitch Dev Mask
  	cmdq	Cmdq pointer
  	En	ISR interrupt enable flag
  	Mode	ISR interrupt mode
  	num	ISR ID
  	VsyncCnt	ISR ID
  	FrameDoneCnt	ISR Frame Done Cnt
  	DropCnt	ISR Frame Drop Cnt
  	crcfailcnt	input crc check fail cnt
  	RdmaVfcFailCnt	input VFC decompress fail cnt
  	3dnrVfcFailCnt	3dnr VFC decompress fail cnt
  	fifofullcnt	fifo full cnt
  	rstcnt	reset hw cnt
  ISP Chn info	DevId	Isp Dev Id
  	ChnId	Isp Chn Id
  	start	Chn Start Flag
  	SnrId	Bind sensorId
  	Sync3A	Sync 3A type
  	chnNum	Muti chn Num
  	Crop	Input Crop Size
  	InSize	Input Size
  	pixel	Input pixel format
  	compress	Input compress type
  	Stride	Input Buffer Stride
  	Atom	Bottom buffers
  	Atom0	There is no buffer at the bottem after the buffer is released
  	Rot	Rotation angle
  	bMirror/Flip	mirror/flip
  	3DNRLevel	3DNR Level
  	HdrMode	HDR mode
  	CustMode	AI ISP Cust Seg mode
  	CustFrom	AI ISP From Cust seg
  	CustTo	AI ISP to Cust
  	PTMax/Cur	Maximum hardware processing time/Current frame hardware processing time
  	PreCnt/EnqCnt/BarCnt/ checkin/checkout/DeqCnt	Callback execution times
  	MaxIv/MinIv	callback execution interval time
  	DropCnt	drop task cnt
  	EnqOTNull	Statistics of times that OutBuffer is Null in Enq
  ISP OutPut Port info	DevId	Dev Id
  	ChnId	Plane id
  	PortID	Port Id
  	Bindtype	Binding mode with post-level
  	Enable	Port enable flag
  	Pixel	Port output pixel format
  	compress	Port output compress type
  	PortCrop	output Crop Size
  	Stride	Output Stride
  	GetCnt	Count of getting Output buffers
  	Failcnt	Count of failed to get Output buffers
  	FinishCnt	Count of finished output buffers
  	fps	Output port frame rate

5.2. echo

# echo help > /proc/mi_modules/mi_isp/mi_isp0

Echo help can view the available commands.

Function	Stop the specified channel.
Command	echo stopchnl [ChnID] [ON/OFF] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	[ChnId] Channel id [ON/OFF] ON: stop chn OFF: start chn
Example	echo stopchnl 0 ON > /proc/mi_modules/mi_isp/mi_isp0

Function	Dump the output data of the selected channel and save it in /path.
Command	echo dumptaskfile [chnid, Cnt, /path/, bOnlyDumpResChange, bdumpport] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: Channel id
	Cnt: Dump count
	Path: Path to store dump files
	bOnlyDumpResChange: Blurred images may be generated when switching resolutions. The dump command and switching resolution operations are not easy to perform together. You can set this parameter first, and then switch the resolution. After the program recognizes it, the buffer after the resolution change will be dumped. (Optional)
	Bdumpport: Only dump a certain portid, the default is to dump all the ports in the output. (Optional)
Example	echo dumptaskfile 0 1 /mnt > /proc/mi_modules/mi_isp/mi_isp0

Function	Set Dev atomvalue
Command	echo setatom [chnid AtomValue] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	chnid: chnel id AtomValue: The maximum number of buffers held by the Driver in input realtime mode
Example	echo setatom 0 3 > /proc/mi_modules/mi_isp/mi_isp0 ps: Increase the atom when the bottom layer is stuck, add a buffer to the driver, and re-trig to see if it recovers, or increase it when the frame is dropped to see if the frame can be full.

Function	Clear the input/output/done of the specified channel portbuffer.
Command	echo clearbuf [chnid, portid bClearInput, bclearoutput, bcleardonebuff] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Portid: port id bClearInput: Clear input buffer bclearoutput: Clear output buffer bcleardonebuff: Clear done buffer
Example	echo clearbuf 0 0 1 0 0 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set debug level
Command	echo debuglv [level] >/proc/mi_modules/mi_isp/mi_isp0 echo debuglv [chnid][level] >/proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Level: Single level parameter: 1:isp api,2:flow,4:check irq done Double level parameter: 1:check buffer,2:check loop,4:check frame pts,8:check fence done,16:check func time,32:check sidebandmsg,64:check zoominfo
Example	echo debuglv 4 > /proc/mi_modules/mi_isp/mi_isp0 //Open check irq done related MI print echo debuglv 0 3 > /proc/mi_modules/mi_isp/mi_isp0 // Open channel0 level3 printing to print buffer info and loop info

Function	Drop frame count
Command	echo skipframe [chnid, skipnum] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id skipnum: drop frame count
Example	echo skipframe 0 60 > /proc/mi_modules/mi_isp/mi_isp0

Function	Clear Bind Q buffer
Command	echo clearbindq [chnid bclear] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id bclear: Whether to clear
Example	echo clearbindq 0 1 > /proc/mi_modules/mi_isp/mi_isp0 //Clear channel0 bindQ buffer The ISP BindQ is full and the front-end cannot get the buffer, and judge whether the ISP is too slow. Clear bindQ and observe whether it will accumulate. If it is, the ISP is too slow, if not, the previous exception is not consumed.

Function	Set the print frame rate, print if it is lower than this value
Command	echo fpsth [chnid portid fpsint fpsfloat] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Portid: port id fpsint: Frame rate integer bits fpsfloat: Frame rate demical bits
Example	echo fpsth 0 0 30 30 > /proc/mi_modules/mi_isp/mi_isp0 //Print the fps which is less than 30.30 in channel0 port0

Function	Set the print pts, print if it is exceeding PTS interval
Command	echo ptsth [chnid portid minptsinterval maxptsinterval] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Portid: port id minptsinterval: pts interval min value maxptsinterval: pts interval max value
Example	echo ptsth 0 0 30000 40000 > /proc/mi_modules/mi_isp/mi_isp0 // Values with PTS interval less than 30ms and more than 40ms in channel0 port0 are printed out

Function	Enable port or not
Command	echo enableport [chnid, portid, bEn] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Portid: port id bEn: 1/0
Example	echo enableport 0 0 1 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set output port parameters
Command	echo outputparam pixel [chnid, portid pixelmode] > /proc/mi_modules/mi _isp/mi_isp0 echo outputparam compress [chnid, portid compressmode] > /proc/mi_modules/mi_isp/mi_isp0 echo outputparam crop [chnid, portid cropX cropY cropW cropH] > /proc/mi_modules/mi_isp/mi_isp0 echo outputparam all [chnid, portid pixelmode compressmode cropX cropY cropW cropH] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id Portid: port id Pixelmode: output pixel format Compressmode: output compress mode cropX: output crop X cropY: output crop Y cropW: output crop width cropH: output crop height
Example	echo outputparam pixel 0 1 11 > /proc/mi_modules/mi_isp/mi_isp0 echo outputparam compress 0 1 5 > /proc/mi_modules/mi_isp/mi_isp0 echo outputparam crop 0 1 0 0 1920 1080 > /proc/mi_modules/mi_isp/mi_isp0 echo outputparam all 0 1 11 5 0 0 1920 1080 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set to always send the same picture
Command	echo sendoneframe [chnid, bEn] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id bEn: 1/0
Example	echo sendoneframe 0 1 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set 3dnr level
Command	echo dnrlevel [chnid, level] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id level: 3dnr level, please refer to MI_ISP_3DNR_Level_e
Example	echo dnrlevel 0 1 > /proc/mi_modules/mi_isp/mi_isp0

Function	Reset ISP entire hardware
Command	echo resethw > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	none
Example	echo resethw > /proc/mi_modules/mi_isp/mi_isp0

Function	Set output CRC check
Command	echo crcmode [chnid, bEn] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id bEn: 1/0
Example	echo crcmode 0 1 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set datagen
Command	echo datagen [chnid, bEn] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	Chnid: channel id bEn: 1/0
Example	echo datagen 0 1 > /proc/mi_modules/mi_isp/mi_isp0

Function	Set the command fetching information executed after cmdq timeout
Command	echo cmdqtimeout [bEn, keyword, cmdline, path] > /proc/mi_modules/mi_isp/mi_isp0
Parameter Description	bEn: 1/0 keyword: Executed commands cmdline: Executed string path: Information saving path
Example	echo 1 cat /proc/mi_modules/mi_isp/mi_isp0 /mnt/cmdqerr.txt > /proc/mi_modules/mi_isp/mi_isp0

5.2.1. ctrlparam

You can manually set the ctrlparam parameter using the echo command.

If you are using an SGS model, the format is as follows:

    # echo ctrlparam [chnid] [k] [s] [minNoiseRatio] [maxNoiseRatio] > /proc/mi_modules/mi_isp/debug_hal/isp_dbg

If you are using a custom model, you can also set ctrlparam using the above interface. The number of parameters depends on your model:

    # echo ctrlparam [chnid] [param_0] [param_1] [...] [param_n] > /proc/mi_modules/mi_isp/debug_hal/isp_dbg

In both formats, if you provide a parameter of -1, the parameter at that position will revert to the default calculation mode.

6. MODPARAM.JSON INTRODUCTION

6.1. The json file content

{

    "E_MI_MODULE_ID_ISP" :
    {
        "u32DefaultDropNum": 10,
        "s32ForceOverlap": -1,
        "s32RotExtraBuf": -1,
        "s32BufLayout": -1,
        "bDefaultDropFifoBuffer": true,
        "bFlushBuffer": true,
        "s32ModuleTotalPlanenum": -1,
        "u32threadPriorityArray": [98],
        "u64PmTimeoutLatencyNS": [1000000000],
        "au8ChnMaxEnqTasks": [0,0,2],
        "bEnableSuspendWaitDone": true,
        "u32DevDbgLv": [0,0],
        "u32ChnDbgLv": [0,0,0,0],
        "isp_clk" : 288000000,
        "rootPath": "/config/iqfile",
        "bSeg1Hdrout": false,
        "bUseHwResetArray": false,
        "bCmdqTimeOutDbgArray": false,
        "u16CpuMaskAffinityArray": 0,
        "u32ChnMaxNumArray": 4,
        "bCrcEnableArray": 0,
        "u32BaseFrameIdxArray": 0
    }
}

The modparam.json is under /config, when ISP is initialized, the json file will be loaded.

---

6.2. ISP common paramaters and paramater description

Parameters	Default	Support chip	Customer configuration	Function
u32DefaultDropNum	10	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp default drop frame num, range [0-U32MAX]
s32ForceOverlap	-1	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp force overlap value, -1: Use internal calculation,or 0, 128, 256, ...
s32RotExtraBuf	-1	Maruko, Opera, Souffle, Pcupid and later chip	N	Set whether isp rot use extra buffer, 0: not use, 1: use, -1: use internal calculation
s32BufLayout	-1	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp buffer layout, -1: Use internal calculation, 0: normal frame, 1: split left and right, 2: split top and bottom, 3: multi plane
bDefaultDropFifoBuffer	true	Maruko, Opera, Souffle, Pcupid and later chip	Y	Set whether isp drop fifo buffer by default, false: disable, true: enable
bFlushBuffer	true	Maruko, Opera, Souffle, Pcupid and later chip	Y	Set whether isp flush buffer, false: disable, true: enable
s32ModuleTotalPlanenum	-1	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp total Plane number, -1: Use internal calculation,range [0-U32MAX]
u32threadPriorityArray	98	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp dev work thread priority, range [0-U32MAX]
u64PmTimeoutLatencyNS	[1000000000]	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp dev max pm timeout,[0-U64MAX], set the max pm timeout of each dev in order
au8ChnMaxEnqTasks	[0,0,2]	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp dev channel max enque task num. This parameter is grouped into 3, each group of parameters is dev, channel, taskNum [0-U8MAX]
bEnableSuspendWaitDone	true	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp waits for tasks to complete before entering suspend，false: disable, true: enable
u32DevDbgLv	[0,0]	Maruko, Opera, Souffle, Pcupid and later chip	N	set isp dev debug level. This parameter is grouped into 2, each group of parameters is dev, dbglv [0-U32MAX]
u32ChnDbgLv	[0,0,0,0]	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp dev channel debug level. This parameter is grouped into 4, each group of parameters is dev, channel, passid, dbglv[0-U32MAX]
isp_clk	0	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp clock, [0-U32MAX]，0: Use the value configured by dts
rootPath	""	Maruko, Opera, Souffle, Pcupid and later chip	N	Set isp root path of iqfile，empty string means use the default value：/config/iqfile in pure linux，/misc in dualos
bSeg1Hdrout	false	Maruko, Opera, Souffle, Iford and later chip	Y	Set isp seg1 output path, 0: before 3dnr, 1: after hdr
bUseHwResetArray	false	Maruko, Opera, Souffle, Iford and later chip	Y	Enable isp dev default hw reset or not, 0: disable, 1: enable
bCmdqTimeOutDbgArray	false	Maruko, Opera, Souffle, Iford and later chip	N	Enable dev default cmdq timeout debuginfo or not, 0: disable, 1: enable
u16CpuMaskAffinityArray	0	Maruko, Opera, Souffle, Iford and later chip	N	Set the cpu which isp dev thread can repond on, 0: Use all cpu by default, bit0-3 -> cpu 0-3, like: 6 means that use cpu1 and cpu2
u32ChnMaxNumArray	4	Maruko, Opera, Souffle, Iford and later chip	N	Set isp dev max channels,[0-U32MAX]
bCrcEnableArray	0	Maruko, Opera, Souffle, Iford and later chip	N	Enable isp port crc or not, 0: disable, 1: enable
u32BaseFrameIdxArray	0	Maruko, Opera, Souffle, Iford and later chip	N	Set isp port basic frame index, [0-U32MAX]

7. Attention

7.1. STA

When binding VIF and ISP frame mode, in order to reduce statistical delay, VIF's hardware supports AE/AF statistics on input images, but it can only choose one from ISP's STA statistics. Moreover, these two places are often easily confused. For users, simply remember the following conditions.

(1) STA using ISP

Modparamjson, ISP's node is configured with bUseVifStat set to false

    "E_MI_MODULE_ID_ISP"
    {
        ...
        "bUseVifSta" : false,
        ...
    } ,

When configuring VIF, the MI_VIF_Create DevGroup's MI_VIF_GroupAttr_t parameter needs to set u32MetaDataTypeMask to 0

    MI_VIF_GroupAttr_t stGroupAttr;
    memset(&stGroupAttr, 0x0, sizeof(MI_VIF_GroupAttr_t));
    ...
    stGroupAttr.stMetaDataAttr.u32MetaDataTypeMask = 0;
    MI_VIF_CreateDevGroup(groupId, &stGroupAttr);
    ...

(2) STA using VIF

Modparamjson, the ISP node has configured bUseVifStat to be true (or do not configure it, default is true)

    "E_MI_MODULE_ID_ISP"
    {
        ...
        "bUseVifSta" : true,
        ...
    } ,

When configuring VIF, the MI_VIF_Create DevGroup's MI_VIF_GroupAttr_t parameter needs to set u32MetaDataTypeMask to 20

    MI_VIF_GroupAttr_t stGroupAttr;
    memset(&stGroupAttr, 0x0, sizeof(MI_VIF_GroupAttr_t));
    ...
    stGroupAttr.stMetaDataAttr.u32MetaDataTypeMask = E_MI_VIF_METADATA_AE_STAT | E_MI_VIF_METADATA_AF_STAT;
    MI_VIF_CreateDevGroup(groupId, &stGroupAttr);
    ...

If you find that the statistical values or image effects are incorrect, you can check if there is a logical configuration error in the statistical values section.

7.2. rotate

When using AI BNR, there are some limitations to ISP's rotation (ROT) because the AI models used for rotation and non rotation are different. Therefore, if rotation is to be performed, it is necessary to add a reloaded AI model with rotation on the basis of the original rotation process (call MI_ISP_LoadAiBnrModel).

7.3. multi-chn aibnr

If you need to perform any of the following actions, you need to configure additional parameters in modparam.json:

• Running a single sensor with dynamic disabling and enabling aibnr during operation

• Running multiple sensors with at least one sensor potentially enabled, regardless of whether dynamic switching is required

Parameter Description:

"E_MI_MODULE_ID_ISP" :
{
    "bEnableAiBnrArray": [true, true],
    "s32ResolutionArray": [2560, 1440, 15, 2688, 1520, 15],
},

• bEnableAiBnrArray: Array indicating whether AiBnr can be enabled for each channel. If enabled, set to true.

• s32ResolutionArray: Specifies the width, height, and fps of each channel. These must match during runtime, otherwise errors will occur.