CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file. See standard-version for commit guidelines.

0.15.0 (2024-08-17)

⚠ BREAKING CHANGES

• remove ResourceManager base class (#1210)
• move Logger from Mediapipe.Unity to Mediapipe (#1208)
• drop Unity 2020 support (#1207)

Features

• Image Segmentation sample scene (#1232) (94f5a1c)
• implement ImageSegmenter (#1225) (7cfa666)
• implement ObjectDetector (#1220) (e007dd7)
• Read the input Texture on GPU (#1245) (1dd8fef)
• remove legacy solutions (#1233) (a38f0d6)
• Task API with GPU Image (#1242) (e9b1fe4)
• update the sample app scenes (#1234) (cc53aa8)

Bug Fixes

• add missing descriptions of PoseLandmarker models (#1235) (d043b90)
• dispose callback arguments (#1244) (efb103a)
• fail to rerun the sample graph (#1219) (4edbe4e)
• sample: workaround for #1196 (#1206) (1a9b193)

refactor

• move Logger from Mediapipe.Unity to Mediapipe (#1208) (994beee)
• remove ResourceManager base class (#1210) (741dc4a)

Build System

• change the default AssetLoader type (#1247) (ab78d5c)
• drop Unity 2020 support (#1207) (d5b141c)

0.14.4 (2024-06-24)

Bug Fixes

• diffs when building or importing (#1201) (b795a98)

Build System

• MediaPipe v0.10.14 (#1200) (4bae91d)
• Update the Unity version (2022.3.34f1) (#1202) (77f96d6)

0.14.3 (2024-03-15)

0.14.2 (2024-03-15)

Features

• get ClassificationResult / List from Packet (#1134) (b9e0c49)
• implement AudioClassifier (#1137) (3753fdf)
• implement Packet.CreateColMajorMatrix (#1133) (af74bb2)
• implement Packet.At (#1136) (d397429)

Bug Fixes

• dispose native resources of segmentation masks properly (#1166) (019a655)
• the sync mode fails when trying to get the ImageFrame result (#1142) (b6961e5)

0.14.1 (2024-01-26)

Bug Fixes

• all landmarks except the first one are always null (#1125) (73554f2)
• sample: Android build error (#1127) (77183c6)

0.14.0 (2024-01-08)

⚠ BREAKING CHANGES

• strongly-typed Packet, once again (#1120)
• remove deprecated APIs (#1119)

Features

• remove deprecated APIs (#1119) (a6e67e3)
• strongly-typed Packet, once again (#1120) (4f3668e)

0.13.1 (2024-01-06)

0.13.0 (2024-01-06)

⚠ BREAKING CHANGES

• sample: remove Start Scene (#1017)
• make Status internal (#959)
• remove StatusOr API (#958)
• implement TaskRunner API (#941)

Features

• add FaceDetector sample (#975) (a3af2d8)
• add the numFaces option to FaceDetectorOptions (#984) (a1da808)
• build Image/ImageFrame from Texture2D (#1083) (bcce0e9)
• CalculatorGraph supports non-generic Packet (#1107) (dfd2034)
• implement BaseOptions (#948) (d1e7b51)
• implement BaseVisionTaskApi (#956) (dde2ee2)
• implement Components.Containers.* (#972) (3eb66c8)
• implement DetectionResultAnnotationController (#983) (8dbf3f1)
• implement FaceDetector (#974) (c777113)
• implement FaceLandmarker (#992) (8f79eee)
• implement FaceLandmarker sample (#994) (4c552e3)
• implement HandLandmarker (#997) (6030526)
• implement HandLandmarker sample (#998) (887f74b)
• implement Image (#957) (889e8ca)
• implement ImageVectorPacket (#1020) (e9f06d0)
• implement non-generic OutputStreamPoller (#1106) (73dbdff)
• implement non-generic Packet class (bool/bool vector) (#1068) (7441b9c)
• implement Packet.CreateDouble, Packet.GetDouble (#1069) (36ba644)
• implement Packet.CreateFloat, Packet.GetFloat (#1070) (9a042b2)
• implement Packet.CreateFloatArray(Vector), Packet.GetFloatArray(List) (#1071) (5e0449d)
• implement Packet.CreateGpuBuffer (#1104) (71c63d9)
• implement Packet.CreateImage, Packet.GetImage (#1072) (6e14fda)
• implement Packet.CreateImageFrame, Packet.GetImageFrame (#1073) (b476a43)
• implement Packet.CreateInt, Packet.GetInt (#1074) (d495193)
• implement Packet.CreateProto, Packet.GetProto (#1079) (df48262)
• implement Packet.CreateString, GetString, GetBytes (#1102) (84181bf)
• implement Packet.GetProtoList (#1080) (0a302b2)
• implement PacketsCallbackTable (#971) (eeeec33)
• implement PoseLandmarker (#1022) (01cdd56)
• implement PoseLandmarker sample (#1064) (bbd79b9)
• implement TaskRunner API (#941) (77d0f16)
• implement TextureFrame and TextureFramePool (#965) (c827fb1)
• initialize RectPacket from proto (#970) (d8593f7)
• marshal ClassificationResult (#1090) (36875b2)
• marshal DetectionResult (#1089) (ff0bd1c)
• marshal Landmarks (#1098) (04752fd)
• marshal NormalizedLandmarks (#1088) (6e5fa2e)
• port ClassificationResult and Landmark (#991) (7252d53)
• read pixel data from Image (2f37866)
• sample: drop non-blocking sync mode (#1110) (589b335)
• sample: remove Start Scene (#1017) (059b0b2)

Bug Fixes

• avoid a callback being invoked after the OutputStream has been disposed (#1112) (74c1c85)

• determine the GrahpicsFormat at runtime (#980) (514a0a9)

• dispose segmentation mask packets (#1066) (370bc5c)

• dispose TextureFrame references instantly (#981) (678596f)

• fix the bazel version to build bazel (#995) (bf5ec2a)

• flickering when running asynchronously (#1111) (7e1b939)

• get pixel data pointer correctly (#1061) (ec3e4d7)

• modelAssetBuffer cannot be specified (#1084) (3ee44bd)

• pass timestamp millisec as a long value (#1094) (af78c5d)

• proper autofit image if camera is rotated (#1043) (2d2863e)

• switch front/back cameras (#1060) (6a74693)

• make Status internal (#959) (9b3d33c)

• remove StatusOr API (#958) (dd4c50e)

0.12.0 (2023-06-24)

⚠ BREAKING CHANGES

• MediaPipe 0.10.1 (#924)
• use Ubuntu 20.04 as the base image (#921)

Bug Fixes

• include MediaPipeUnity.framework in unitypackage (#882) (7c43b75)

build

• MediaPipe 0.10.1 (#924) (9d5c618)
• use Ubuntu 20.04 as the base image (#921) (f08fd92)

0.11.0 (2023-03-03)

⚠ BREAKING CHANGES

• hide StdString from developers (#834)

• hide StdString from developers (#834) (1eac8b1)

0.10.3 (2022-12-28)

Features

• add FloatVectorPacket and MatrixPacket (#767) (391d7d9), closes #656
• make mask color transparent (#733) (f196f46)

Bug Fixes

• avoid drawing holistic landmarks twice (#755) (30cd149)
• ignore core.autocrlf (#807) (f2bc51b)
• stop running OnValidate on immutable prefabs (#810) (f545346)

0.10.1 (2022-07-09)

Features

• objectron: set confidence parameters at runtime (#605) (af86a8e)

Bug Fixes

• docker freezes when building a Docker Windows image (#631) (727b7ff)
• OpenCV paths os macOS (#592) (358f7b9)
• some tests fail on Windows (#644) (0a90ac1)

0.10.0 (2022-05-20)

⚠ BREAKING CHANGES

• Unity 2021 (#588)
• plugin: Logger.minLogLevel -> Logger.MinLogLevel (#580)
• callback functions return StatusArgs instead of Status (#574)
• coordinate transform and other helper methods (#569)

Features

• add scenes for tutorial (#582) (c9e0317)
• plugin: add missing Status factory methods (#573) (ba48f78)
• plugin: implement GpuManager (#579) (1d9196a)
• plugin: mediapipe v0.8.10 (#585) (738f3f7)

Bug Fixes

• plugin: OutputStream#TryGetNext throws if it's not started (#581) (9e99400)

• some tests abort on Windows (#572) (bd2c390)

• callback functions return StatusArgs instead of Status (#574) (d334e80)

• coordinate transform and other helper methods (#569) (527d3b1)

• plugin: Logger.minLogLevel -> Logger.MinLogLevel (#580) (456a822)

build

• Unity 2021 (#588) (5d392db)

0.9.3 (2022-05-16)

0.9.2 (2022-05-16)

Bug Fixes

• Enumerator can be invalid when an item is deleted (#565) (d8e061a)
• plugin: check if the target local asset is missing (#562) (e3fa454)
• plugin: preserve Packet constructors for Reflection (#561) (a6f27b1)
• plugin: prevent Status returned by a packet callback from being GCed prematurely (#563) (f4301af)
• sample: dispose OutputStream if only it exists (#564) (dcee215)
• sample: the default video/image is not selected (#543) (77ba1a4)

0.9.1 (2022-04-19)

Features

• sample: Holistic Segmentation Mask (#521) (30e968c)
• sample: MIN_DETECTION_CONFIDENCE and MIN_TRACKING_CONFIDENCE (#523) (5222faa)
• sample: Pose Segmentation Mask (#520) (b25430d)
• sample: Selfie Segmentation (#522) (7d6090d)
• set Protobuf LogHandler (#526) (cc3ac5c)

Bug Fixes

• constructor should throw if it fails to initialize (#533) (e58408e)

0.9.0 (2022-04-07)

⚠ BREAKING CHANGES

• implement ImageFrame#TryReadChannel and MaskShader (#507)

Features

• OutputStream API (#516) (2679000)

Bug Fixes

• check Packet types at compile-time more properly (#509) (d03895d)

• forget to commit (#510) (81fe7f8)

• ignore vertically_flipped in sync mode (#517) (7d080e3)

• plugin: fail to initialize GlSyncPoint (#515) (11188cb)

• implement ImageFrame#TryReadChannel and MaskShader (#507) (05adcb5)

0.8.4 (2022-03-29)

Features

• plugin: port ValidatedGraphConfig API (#477) (bde6874)
• sample: implement MIN_(DETECTION|TRACKING)_CONFIDENCE (#483) (13c2a38)

Bug Fixes

• install OpenCV 3.4.16 on Docker Windows Containers (#484) (4210673)
• sample: Anchor position is flipped (#506) (98cb0c4)
• sample: front camera image is not rotated properly (#504) (9d47f7c)
• sample: GetNativeTexturePtr may never return on M1 Mac (#505) (9d7e390)

0.8.3 (2022-02-27)

Features

• add Non-Blocking Sync mode to the sample app (#471) (3a33e9d)
• compile with emscripten (#395) (de44dac)

Bug Fixes

• build AAR on Docker (#441) (75a736a)
• configure plugin settings (#381) (ee27e24)
• memory for RenderTexture leaks (#451) (6a1d120)
• no need to pin callbacks (#460) (0dafc8a)
• OpenCV installation path is incorrect (#459) (6e60f75)
• plugin: load mediapipe_c.dll on Windows properly (#455) (e237ba7)
• sample: smooth_landmarks option is not working (#454) (c90861c)
• SerializedProto's memory leaks (#461) (ac6316d)
• typo and missing [Test] (#426) (018bd9f)

0.8.2 (2021-12-15)

Features

• deps: MediaPipe v0.8.9 (#376) (a16d74c)

0.8.1 (2021-12-02)

Bug Fixes

• sample: Hand Landmarks color is wrong in Holistic scene (b1a2720)
• sample: image is flipped in sync mode (a3668be)
• flip screen image when using front facing camera (f04ba48)
• releasing active render texture (9537ec7)
• example: model_complexity is ignored (0d9db0b)
• sample: memory leaks when using VideoSource (cab8e26)
• build with bazel 4.2.1 on macOS (4921db1)
• synchronize the input image and the output annotation (#359) (47598ce)
• validate bundle_id (06423ca)

0.8.0 (2021-11-22)

⚠ BREAKING CHANGES

• MediaPipe v0.8.8 (#356)
• add .editorconfig and analyzers (#308)

Features

• sample: support refineFaceLandmarks option (Holistic) (b669ac1)
• sample: support refineLandmarks option (Face Mesh) (a76194f)
• allow the default camera resolution to be set (#347) (4826ee2)

Bug Fixes

• add missing Assert() (a7dbfd7)

• AssetBundle can be loaded only once (#309) (702434d)

• dead link (#333) (4d90ac4)

• docker command (2994e44)

• enable OpenCL on Android (383b373)

• MediaPipeVideoGraph fails in CPU mode (ca77c3f)

• missing MarshalAs (67155d5)

• show errors when failed to initialize GpuResources (f059091)

• thread hangs after running tests (9c3db9a)

• unzip does not extract *.so recursively (a9edb9e)

• add .editorconfig and analyzers (#308) (a3b90d1)

build

• MediaPipe v0.8.8 (#356) (c603366)

0.7.0 (2021-09-27)

Features

• New Sample App (#296) (7bb877d)

Bug Fixes

• cannot pass linker options to clang (b8ea5c1)
• PacketPresenceCalculator does not work with PoseTracking (d58ab72)

0.6.2 (2021-07-11)

Features

• example: enable to get pose world landmarks (abbade0)
• example: enable to switch face detection models (58084e8)

0.6.1 (2021-07-04)

Bug Fixes

• cannot install msys2 packages (5db311e)
• holistic sample flickers (49c275b)
• rules_cc's branch name (#211) (24576ce)
• typo (debug -> dbg) (67fcb0a)
• use gcc-10 and g++-10 (a3332df)

0.6.0 (2021-05-15)

Features

• read .binarypb (3ca8642)
• sdk: implement FaceGeometryPacket (473c3a0)

Bug Fixes

• return type is wrong (4ca0f5f)

0.5.3 (2021-04-30)

Bug Fixes

• docker: zip command is not installed (aa8e1bd)

0.5.2 (2021-04-30)

Bug Fixes

• copytree fails on Windows (Docker) (fd0e83c)
• fail to build mediapipe_android.aar (24fe5db)
• modify bsdtar command typo "s" (#120) (33c0bd3)
• nuget fails on Ubuntu or Debian (e00e4ae)
• rules_foreign_cc version must be 0.1.0 (780d405)
• wildcard is not expanded (dd99867)
• example: failed to compile when the target is Android (92cad4b)

0.5.1 (2021-03-21)

⚠ BREAKING CHANGES

• place ResourceManager classes under SDK directory

Features

• example: Objectron (bd470eb)

Bug Fixes

• add a missing command (de132bd)

• build error (fe2f97f)

• build for iOS and Android (7a815f9)

• failed to apply a patch (049ca2f)

• graph starts before saving model files (7f9f6b0)

• place ResourceManager classes under SDK directory (c67a456)

0.5.0 (2021-02-22)

⚠ BREAKING CHANGES

• pkg_model -> pkg_asset

Features

• sdk: implement FloatArrayPacket (9a0780c)
• compile StickerBuffer (0a4720b)
• implement APIs to get model matrices (fe35345)
• InstantMotionTracking (ee7c909)
• StringPacket can contain null bytes (1d5240e)

Bug Fixes

• example: not to create redundunt instances (56ee74f)

• test: thread hangs (32f30f3)

• not to flip input images horizontally when mediapipe outputs images (28e429c)

• typo (ee91e5b)

• pkg_model -> pkg_asset (20083ff)

0.4.3 (2021-02-07)

Features

• Holistic with iris (0bf2bdd)

Bug Fixes

• example: request user permission before searching webcam devices (9954a52)
• add missing attributes (683b88f)
• example: stop disposing gpu_helper (94deaba)
• example: Unity Editor hangs after exiting play mode (6cc0ed1)
• correct compilation conditions (b787ee3)
• standalone executable does not shut down (85c77aa)

0.4.2 (2021-01-30)

Features

• example: Box Tracking (c6d5560)
• render pose landmarks (6a26384)
• render pose roi and detection (026b6c8)
• example: holistic on CPU, Android and iOS (47ddbdd)
• sdk: build for windows (aab99a8)

Bug Fixes

• example: remove stale annotations (61f2041)
• example: timestamp can be same as the previous one on Windows (411fc68)
• cannot make ios_arm64 (43e0cba)
• limit path length for Windows (4838408)
• made it possible to run editor while on iOS/Android platform target (#37) (b7e3bb7)
• maybe required to preload (6646d56)
• patch (box tracking) (8063e6d)
• use microseconds as a Timestamp value (8e00358)
• wrong file path (14fc75d)

0.4.1 (2021-01-17)

Features

• add android_arm64 target (70d46d9)

0.4.0 (2021-01-16)

⚠ BREAKING CHANGES

• define callbacks as static methods for IL2CPP

Features

• sdk: GlCalculatorHelper#GetGlContext (3238cf6)

Bug Fixes

• remove readonly (7fdf71a)

• suppress C linkage errors (461d019)

• wait for WebCamTexture to be initialized (8fd204c)

• define callbacks as static methods for IL2CPP (0172e01)

0.3.0 (2020-12-31)

⚠ BREAKING CHANGES

• example: pass the input texture name to MediaPipe
• example: MediaPipe rotates the input image
• use OpenGL ES on Android

Features

• example: enable to specify the output texture on Android (18e00a8)
• example: implement TextureFramePool (9723843)
• example: pass the input texture name to MediaPipe (7f3628d)
• example: render external textures directly (ebbf0ed)
• add Official Demo Graph (7a340f9)
• use OpenGL ES on Android (a10efce)
• sdk: add GlTextureBuffer APIs (1643620)
• sdk: build CalculatorGraphConfig.cs from proto srcs (9e576e2)
• sdk: CreateDestinationTexture from GpuBuffer (48ba090)
• sdk: implement EglSurfaceHolder (380a8c5)
• sdk: implement name related APIs under mediapipe::tool (e967820)

Bug Fixes

• SIGSEGV when GlTextureBuffer is destroyed (a1e4cc0)

• example: use FlowLimiterCalculator in OfficialDemoCPU graph (f92d71a)

• example: MediaPipe rotates the input image (0eda94c)

0.2.2 (2020-12-19)

Features

• add APIs to initialize GpuResources with the current context (c66d255)
• add Glog APIs for debugging (085f7cc)
• implement CalculatorGraph#ObserveOutputStream (fad3ca1)

Bug Fixes

• add missing dependencies for Mac (94a2a76)
• build for macOS (b24e3eb)
• sdk: set GlTextureBuffer's shared pointer (5bc68c7)
• hangs if resource files not found (a4186c2)
• I/F has changed (65bc5a7)
• method name typo (4c642b5)
• typo (ef78637)
• width <-> height (27d2eff)
• width <-> height (62e4fb5)

0.2.1 (2020-11-24)

Features

• sdk: GlContext and GlSyncToken API (79b3e83)
• sdk: implement GlSyncToken API (9f8435e)
• sdk: implement GlTextureBuffer API (31d3deb)
• sdk: implement Timestamp API (f647755)
• add CalculatorGraph APIs (679c3fb)
• add GlContext APIs (755a643)
• handle SIGABRT (ee0c4c3)
• implement IntPacket (2eea5b2)
• upgrade MediaPipe(0.8.0) (3b58752)

Bug Fixes

• add missing dependencies (6524d57)
• build: fix aar path (6cab320)
• sdk: correct GpuBufferFormat values (260a048)
• fails to longjmp sometimes (f884865)
• ptr is not set (7c6af2f)
• thread hangs when an error occured in RunInGlContext (388899b)

0.2.0 (2020-10-14)

Features

• build for Android (d058ddd)
• example: read local files in UnityEditor env (e0e8795)
• example: use AssetBundle (25ce035)
• sdk: implement path resolver for unity (468d444)

Bug Fixes

• example: wait for the assets to be loaded (4cd0d2e)

0.1.1 (2020-09-27)

Features

• example: enable to switch graph (2bb63f4)

Bug Fixes

• example: close the input stream (26038da)