I don't know about Publisher, but perhaps it was not including because it is going to be deprecated.
https://support.microsoft.com/en-us/office/microsoft-publisher-will-no-longer-be-supported-after-october-2026-ee6302a2-4bc7-4841-babf-8e9be3acbfd7
Access has the new icons. I believe that the rollout is uneven, though. If you don't have it yet, it should become available soon.
It is not true, by the way that Access is in extended maintenance mode. Rumors of the demise of Access continue to circulate regardless of reality. Giving credence to those rumors in posts like this is part of the problem.
See the statements regarding future development plans for Access by Linda Canon, the product manager for Access, at the recent AEK Conference, as quoted on AccessForever.org. https://www.accessforever.org/post/microsoft-s-plans-for-access-oct-25-march-26