Why does my driver window go down but can't go up alone?

My 2004 Mazda 3 hatch driver side window can go down without issue however it cannot go up on just its own. If I just move the driver side switch alone nothing happens. It can only go up if I try put another window up at the same time (eg flip the passenger or rear window switches in the up position at the same time I try the driver side window switch).

From my research it seems like a possible switch issue? However this workaround seems fairly unique so was curious if something else was going on. Thanks!