Milter-greylist

Anyone have problems sending email to Verizon?

I'm getting the message:
# mailq
                 /var/spool/mqueue (1 request)
-----Q-ID----- --Size-- -----Q-Time----- ------------Sender/ 
Recipient-----------
k1PIjSIn092590      231 Sat Feb 25 10:45 <me@...>
                  (Deferred: 450 Requested mail action not taken-Try  
later:sv6p)
                                          <user@...>
                 Total requests: 1


When I check the maillog, I see entries like so:

Feb 25 10:45:30 planx milter-greylist: k1PIjU7w092774: addr  
206.46.252.150 from <> to <me@...> delayed for 00:08:00

Feb 25 10:45:30 planx sm-mta[92774]: k1PIjU7w092774: Milter:  
to=<me@...>, reject=451 4.7.1 Greylisting in action, please  
come back in 00:08:00

Feb 25 10:45:30 planx sm-mta[92765]: k1PIjSIn092590:  
to=<user@...>, ctladdr=<me@...> (1001/1001),  
delay=00:00:02, xdelay=00:00:01, mailer=esmtp, pri=30724,  
relay=relay.verizon.net. [206.46.232.11], dsn=4.0.0, stat=Deferred:  
450 Requested mail action not taken-Try later:sv14pub.verizon.net

Feb 25 10:45:30 planx sm-mta[92774]: k1PIjU7w092774: lost input  
channel from sv14pub.verizon.net [206.46.252.150] to MTA-v4 after rcpt

Feb 25 10:45:30 planx sm-mta[92774]: k1PIjU7w092774: from=<>, size=0,  
class=0, nrcpts=0, proto=SMTP, daemon=MTA-v4,  
relay=sv14pub.verizon.net [206.46.252.150]


This appears to me, to be an endless loop. Verizon won't accept my  
email unless, I accept theirs... etc.
And since the responding server changes every time I send, milter- 
greylist won't be able to whitelist the verizon server. (I've seen:  
sv25 sv15pub sv2pub sv6pub sv14pub )


Doing a search on the internet I found the following helpful  
explanation:
http://blog.kloppmagic.ca/archives/2005/02/24/verizon-450-requested- 
mail-action-not-taken-try-later-error/

My SPF tag has been set for well over a year... so that didn't solve  
the issue.

I find it odd, that this didn't occur with milter 1.3?, but then  
again... I upgraded to a new server/ip 2 days ago (well after the  
24hr ttl of dns), with the latest and greatest of everything.  
(sendmail, clamav-milter (finally), spam-milter )

For the time being I've whitelisted 206.46.252.142/24
Does anyone have any other ideas?

Thanx,
Bill