2024 May APAC Community Sync

[ChenSammi]

May 10th
Attender: Xi, Hao, Hongbing, Jianghua, Conway, Yuanben, Hualong, Leechungen, Mingyu, Wei-Chiu, Sammi

Sammi:

1. Java 17 support reaches an milestone. Build and run with Java 17 is supported.
2. S3 compatibility test and improvements.
3. Recon has a lot of improvements.
4. Security FIPS compliance is started.

Hongbing/Jianghua

1. Java 17 build and function test passed. Will evaluate performance next.
2. How to trace and investigate S3g tail latency. HDDS-9716/HDDS-9718 has been implemented by Xi, which adds performance metrics and audit logs.

Hao/Mingyu

1. How to recover mis-deleted files. Suggest to consider enable Trash, while it looks like OBS is not supported. Add a CLI command to enabled and disable keyDeleting service in OM.
2. OM Memory pressure due to object serialization and de-serialization. Found some improvement points, and are working on it.
3. Container balancer. Suggest to consider unmodifiableSet to void ContainerIDs copy in each iteration, by @siddhantsangwan .

[ChenSammi]

May 24th

Attender: Xi, Hao, Hongbing, Jianghua, Conway, Yuanben, Hualong, Mingyu, Sammi

Xi

• There is one data integrity issue found in trunk branch https://issues.apache.org/jira/browse/HDDS-10750
  , which need to be fixed, and is a blocker issue for 1.4.1 release.

Hongbing/Jianghua

• Shared a very good document about difference GC algorithm comparison. https://docs.google.com/document/d/1g1h-63fvA-be-clvyVRAHLWehoadCnjNRWyX8Bp-UIU/edit#heading=h.97c7fvoio7b1. G1 has a very good potential to replace CMS.
• Implementing a client side viewFS for Ozone, per internal requirement.

Hao

• Identified some memory footprint optimization points of container balancer, filed HDDS-10868 for this.
• DN Block deletion selection algorithm topN, if the top container doesn't finish in time, in next iterator, this container will be selected again. Due to the container lock is still locked by previous iterator thread, the next iterator thread has to wait until the lock is released. This thread resource is not fully utilized.