Unexpected error when logging Segmentation Image and Annotation Context together

[jleibs]

Repro

This fails:

import numpy as np
import rerun as rr

image = np.zeros((8, 12), dtype=np.uint8)
image[0:4, 0:6] = 1
image[4:8, 6:12] = 2

rr.init("rerun_example_segmentation_image", spawn=True)

rr.log(
    "/image",
    rr.SegmentationImage(image),
    rr.AnnotationContext([(1, "red", (255, 0, 0)), (2, "green", (0, 255, 0))]),
)

And produces the error:

[2024-05-27T21:27:54Z ERROR re_space_view_spatial::visualizers::images] Failed to create rectangle draw data from images: Color mapping is being applied to a four-component RGBA texture

This works:

import numpy as np
import rerun as rr

image = np.zeros((8, 12), dtype=np.uint8)
image[0:4, 0:6] = 1
image[4:8, 6:12] = 2

rr.init("rerun_example_segmentation_image", spawn=True)

rr.log(
    "/image",
    rr.SegmentationImage(image),
)

rr.log(
    "/image",
    rr.AnnotationContext([(1, "red", (255, 0, 0)), (2, "green", (0, 255, 0))]),
)

Expected Behavior

These should be equivalent.