AR mode

[RjvPivs]

Hello there! I`ve just started learning the engine and I want to ask if it is possible to create an AR mode with it.

[soywiz]

@RjvPivs by AR do you mean Augmented Reality?

[RjvPivs]

Yep

[soywiz]

Wow, that was quick.

AR is not supported right now. What would be your use-case?

[RjvPivs]

I want just to use camera as a background. Is this fully impossible?

[soywiz]

Oh I see. No, I didn't meant it was not possible, just that there is nothing specific implemented in KorGE about that.
You can use the camera API for the operating systems you are using and place them into a texture; for example Android and iOS and grab the image sequences and use them in code.
For example: https://developer.android.com/media/camera/camera-deprecated/camera-api

To avoid fetching pixels from the camera, if there is an API to get an OpenGL texture from the camera:
https://stackoverflow.com/questions/57331861/get-the-opengl-texture-handle-from-a-surfacetexture

Then you can use ForcedTexNativeImage:

korge/korge/test/korlibs/korge/render/AgBitmapTextureManagerTest.kt

Lines 85 to 94 in 11993ae

	class FixedNativeImage(
	override val forcedTexId: Int = 100,
	override val forcedTexTarget: Int = KmlGl.TEXTURE_EXTERNAL_OES,
	) : ForcedTexNativeImage(100, 100, false) {
	override val name: String get() = "FixedNativeImage"
	}
	val image1 = Bitmap32(1, 1, Colors.RED)
	val fixedNativeImage = FixedNativeImage(100)
	val fixedNativeImage2 = FixedNativeImage(101)

This class would give you a Bitmap instance whose pixels when rendering are provided by a specific OpenGL texture with a specific integral opengl id:

class FixedNativeImage(
    override val forcedTexId: Int = 100,
    override val forcedTexTarget: Int = KmlGl.TEXTURE_EXTERNAL_OES,
) : ForcedTexNativeImage(100, 100, false) {
    override val name: String get() = "FixedNativeImage"
}

And you should be able to use it places where you are using Bitmap, like in a image.

[RjvPivs]

Great, thank you! I`ll check and try this