HDDS-4474. [Ozone-Streaming] Use WriteSmallFile to write small file.#2860

Closed

guohao-rosicky wants to merge 37 commits intoapache:HDDS-4454from

guohao-rosicky:HDDS-4454-small-file

Commits on Mar 15, 2022

HDDS-5366. [Ozone-Streaming] Implement stream method to ContainerStateMachine. (#2358). Contributed by mingchao zhao

captainzmc
authored and
szetszwo
committed
HDDS-5452. Add link method to ContainerStateMachine for Ratis streaming (#2422)

kaijchen
authored and
szetszwo
committed
HDDS-5481. Fix stream() and link() method in ContainerStateMachine. (#2451)

kaijchen
authored and
szetszwo
committed
HDDS-5480. [Ozone-Streaming] Client and server should support stream setup. (#2452)

captainzmc
authored and
szetszwo
committed
HDDS-5488. [Ozone-Streaming] Add a new BlockOutputStream/KeyOutputStream to support streaming api (#2495)

kaijchen
authored and
szetszwo
committed
HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer to avoid buffer copying (#2557)

captainzmc
authored and
szetszwo
committed
HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to ByteBufferStreamOutput (#2603)

kaijchen
authored and
szetszwo
committed
HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)

captainzmc
authored and
szetszwo
committed
HDDS-5486. [Ozone-Streaming] Streaming supports writing in Pipline mode (#2682)

captainzmc
authored and
szetszwo
committed
HDDS-5849. [Ozone-Streaming]Write exceptions occur after checksum is enabled (#2729)

captainzmc
authored and
szetszwo
committed
HDDS-5674.[Ozone-Streaming] Handle client retries on exception (#2701)

sadanand48
authored and
szetszwo
committed
HDDS-5895. [Ozone-Streaming] Make raft.server.data-stream.client.pool.size configurable (#2766)

captainzmc
authored and
szetszwo
committed
HDDS-5763. Provide an Executor for each LocalStream in ContainerStateMachine (#2782)
szetszwo
committed
HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream config (#2841)

guohao-rosicky
authored and
szetszwo
committed
HDDS-5961. [Ozone-Streaming] update the usage space of Containers in the stream write (#2833)

guohao-rosicky
authored and
szetszwo
committed
HDDS-5879. [Ozone-Streaming] OzoneBucket add the createMultipartStreamKey method (#2760)

guohao-rosicky
authored and
szetszwo
committed
HDDS-5743. [Ozone-Streaming] Add option to write files via streaming api in ofs and o3fs. (#2770)

sadanand48
authored and
szetszwo
committed
HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer fixed boundary for streaming writes. (#2866)

sadanand48
authored and
szetszwo
committed
HDDS-6039. Define a minimum packet size during streaming writes. (#2883)

sadanand48
authored and
szetszwo
committed
HDDS-6130. [Ozone-Streaming] When releaseBuffers will get “Couldn 't find the required future” (#2939)

captainzmc
authored and
szetszwo
committed
HDDS-6139. [Ozone-Streaming] Fix incorrect computation of totalAckDataLength. (#2978)

sadanand48
authored and
szetszwo
committed
HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)

sadanand48
authored and
szetszwo
committed
HDDS-6281. Update ratis version to 2.3.0-94db58b-SNAPSHOT version (#3059)

guohao-rosicky
authored and
szetszwo
committed
HDDS-6138.[Ozone-Streaming] Define a limit on the size of the retry bufferList. (#2946)

sadanand48
authored and
szetszwo
committed
HDDS-6298. Add XceiverServerRatis stream config (#3070)

guohao-rosicky
authored and
szetszwo
committed
HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support FlushDelay. (#3002)

captainzmc
authored and
szetszwo
committed
HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE (#3060)

guohao-rosicky
authored and
szetszwo
committed
HDDS-6229. [Ozone-Streaming] Data Channel abstraction on datanode (#3023)

guohao-rosicky
authored and
szetszwo
committed
HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)

guohao-rosicky
authored and
szetszwo
committed
HDDS-6388. [Ozone-Streaming] Streaming write support both pipeline model and star model (#3145)

captainzmc
authored and
szetszwo
committed

Commits on Mar 17, 2022

Commits on Mar 18, 2022

Commits on Mar 21, 2022

Commits on Mar 24, 2022

code review
guohao-rosicky
committed