There's a statute that carves out the border search exemption:

https://www.aclu.org/other/aclu-factsheet-customs-and-border...

So the argument to be made is that the application of the law or the law itself is not in keeping with the Constitution, not that law doesn't even apply.