The modulation of an optical lattice potential that breaks time-reversal symmetry enables the realization of complex tunneling amplitudes in the corresponding tight-binding model. For a superfluid Fermi gas in a triangular lattice potential with complex tunnelings, the pairing function acquires a complex phase, so the frustrated magnetism of fermions can be realized. Bose-Fermi mixtures of bosonic molecules and unbound fermions in the lattice also show interesting behavior. Due to boson-fermion coupling, the fermions become enslaved by the bosons and the corresponding pairing function takes the complex phase determined by the bosons. In the presence of bosons the Fermi system can reveal both gapped and gapless superfluidity.