ad: MLSons-1

QRZ's Data Not in Sync With the FCC?

Discussion in 'Amateur Radio News' started by K5WDW, Apr 11, 2002.

Thread Status:
Not open for further replies.
ad: L-HROutlet
ad: l-rl
ad: L-MFJ
ad: Left-3
ad: Radclub22-2
ad: Left-2
ad: abrind-2
  1. K5WDW

    K5WDW Ham Member QRZ Page

    I upgraded to extra and was granted my new call sign on  April 7 2002 by the FCC AD5IO how come the only call sign server showing this is the FCC's, I thought that all the others got there info from the FCC's, I would think that by now they would all show the new information.

    David
    AD5IO

    The QRZ editor writes:
    To understand the root of the problem one has to realize that the FCC is a big government bureaucracy that is run by a bunch of 9-to-5 employees that have absolutely no stake in amateur radio.  Their computer system is usually about 10 years out of current technology and any custom software they have was either written in-house by an uninspired programmer or was contracted outside to the lowest bidder.  It's well known in Information Technology circles that the brightest stars in high tech don't work for the government.  It's the money.  A competent engineer can easily make twice as much in the commercial sector.

    Let's take a moment to understand how the daily callsign data gets from the FCC to outside callsign servers like QRZ.

    The FCC maintains an FTP site where the public can download almost anything they have.  Way in the back, mixed in amongst all things non-amateur, you'll find the Amateur Radio section where the license files are released to the public.

    There are two classes of files that the FCC provides for download: so-called "Complete" files which contain the entire database of amateurs, and the Daily files which contain everything that was done in the last 24 hours. The Complete files are released weekly, the Daily files, every day - sort of.

    Common sense says that you can go out and fetch the latest Complete file and if you get it on the day it was published, you'll have a perfect copy of the FCC's amateur data (minus the things they must conceal).  Then, if you fetch a new daily file each day and apply it to your copy of the complete file, you stay in sync with their database, or so the theory goes.

    QRZ, like most callsign servers, work almost exclusively with the daily files.  The Complete (weekly) files are way too big - over 60 megabytes compressed - and take hours to upload into a server.  The daily files tend to be very modestly sized (tens of kilobytes) and are easy to deal with every day.  Here at QRZ we have programs (robots) that automatically go out to the FCC site, fetch the new data an insert it into our database.  This happens on a clock timer without any human intervention whatsoever.

    The problem (as you've probably guessed by now) is that the FCC routinely fails to provide an accurate daily update.  We're not talking about the data in their database but the data that they package each day for public distribution.  They also frequently miss days altogether.  They don't tell us when this happens (half the time they are unaware of it), and the result is a loss of database synchronization between QRZ and the FCC.  Such a loss usually minute in percentage terms, unless it's your callsign you're looking for, then it's a crisis.

    At least once a month we get letters from hams stating that "I'm on the FCC website but not on QRZ".  Naturally, it's assumed that it's our fault.  When such complaints start to mount, we bite the bullet and take a Complete load, tying up our server for a couple of hours, usually in prime time.  Then we're golden, at least until the FCC stumbles again.

    Admittedly, some callsign sites do a better job of babysitting the FCC's dumps than we do.  I don't have the time to hover over the files, check them every day, and drop everything whenever there's a hiccup.  I could improve our 'bots to notify me when a day is missed, but, frankly the alarm would be going off every week.  Instead, I'm quite satisfied to be 99% correct, 99% of the time.  Sometimes, like right after a forced Complete load, we're 100% correct with the definition of "correct" taken to mean a complete synchronization with the FCC's data, and all the mistakes it contains.

    So, that's the deal.  We do our best to keep the database in sync but our success rate is usually just below 100%.  I will argue with anybody that we do a pretty good job of keeping track of 1.2 million callsigns (US and foreign), 130,000 registered users, 220,000 email addresses, 30,000 pictures and 50,000 personal biographies.

    I know, however, that when it's YOUR callsign that's missing or inaccurate, that it's a big disappointment.  We don't mind hearing about it and we WILL fix it if it's a database synchronisation error.  We won't fix it if it agrees with what the FCC says, even if it's wrong.  You still have to file an official update in that case.

    I've learned that many hams are very proud of their callsign data and at times unreasonably so.  Case in point: I received an email from someone who had bought the QRZ CDROM which contains a copy of the FCC database.  It gets printed two times per year and is 100% accurate on the day it gets compiled.  The user wrote me to complain that in order to make sure that his recent license upgrade was reflected on the CD that he had waited several months for the new edition to come out.  Unfortunately, he received the new CDROM and it still listed him with his old license class.  Now he's dissatisfied with QRZ and wants some sort of remedy.

    Now I ask, how rediculous is that?  Although I'm not listed in the phone book, do I still want to keep it handy next to the phone?  Yes, absolutely.  Why?  Because I don't go to the phone book to look up my own number anyway.  That's not the reason phone books are printed.  It's also not a reason to delay purchasing a copy of an amateur radio callbook.  Of course, I'm happy to sell them one in any case  [​IMG] since it keeps QRZ running!

    -fred  AA7BQ
     
  2. K1ZC

    K1ZC Ham Member QRZ Page

    You are updated now, at least on QRZ. The reason is that all these call sign servers upload data from batch files created by the FCC. However, due to the sequence used by the FCC to process data, it takes an extra day or so for the new information to make it into those batch files. Couple that with the scheduled downtime at the FCC computer center this past weekend and you get the delay you have seen.

    Welcome to Extra class.
     
  3. Guest

    Guest Guest

    [​IMG] AD5IO ain't in the QRZ data base. But then again, I changed my address on the ULS 3 months ago and that ain't there either. [​IMG]

    The FCC doesn't tell anyone anything until they are ready!

    73 de Craig........KCØGOA [​IMG]
     
  4. KC8TCQ

    KC8TCQ Ham Member QRZ Page

    When I got my license, it took a day or two for the QRZ list to show it while the FCC site had it listed. Thats perfectly understandable. Just be happy with your new priviledges. I am looking forward myself to upgrading.

    73 de Keith

    P.S. the FCC still hasn't changed my info on my address change either
     
  5. Guest

    Guest Guest

    When my callsign was first listed on QRZ, the map link showed me 2 counties away from where my QTH actually is. I discovered (I thought) that QRZ had my zip code wrong, and immediately notified Fred he was wrong! Then, Fred notified me that that was what he had gotten from the FCC. Needless to say, it took awhile to get it fixed on the FCC database. But you know what? The day it got fixed, it appeared right on QRZ also!

    Fred, keep up the good work!

    And to the one whose callsign is not quite right on QRZ...
    the FCC is really the one you have to worry about, because they're the one that matters! [​IMG]
     
  6. KC9BCY

    KC9BCY Ham Member QRZ Page

    [​IMG]
    Thanks for the great explaination, that's much more informative than the FAQ answer to that question, reminds me of the old FIDO mail systems on bbs's i used to call. (landline) I changed my address immediately, after i realized how many people would be seeing it in the near future, to my PO box, and only had updated the CORES listing, but didn't realize why it hand't updated here, or on the ULS, turns out i had to file a 605, and get a new license mailed out before all my address information was updated in the database! a day or so, it was here!

    i like the email addresses, and profiles of QRZ, over the information in the FCC's databse tho! Helps me find, and get acquainted with my new neighbors!

    l8r
     
  7. AB0RE

    AB0RE Ham Member QRZ Page

    I usually check the FCCs website when I need to find information as soon as it is updated.  http://www.fcc.gov/wtb/uls is the URL, I believe.

    The delay getting the info from the FCC to QRZ is understandable.  I appreciate being able to put biographies, website addresses, and email addresses on your QRZ callsign lookup page.  Once in a while it's fun to look somebody up on QRZ.com for more information after meeting them on the air for the first time.
     
  8. W7ARC

    W7ARC Ham Member QRZ Page

    If you are worried about whether or not you're upgrade or license has been processed, why not check the source? QRZ and the rest of the Call Sign Servers get their information from the FCC and you can check them anytime at http://www.fcc.gov/wtb/uls. The lastest information is always there.

    73 W7ARC
    Silverdale, WA
     
  9. K0OU

    K0OU Ham Member QRZ Page

    I thought it was just my computer, but when I go into the Callsign Database, and click on Latest FCC updates I get the site that lists the new updates by callign- and that site has not been updated in some months. Although the date at the top of the page is current, the callsigns have not changed since sometime in December or January.
    The New Hams/FCC reports seems to be current and lists the updates in alphabetical order by name, but I like to follow what callsigns are being issued now. So I miss the listing by callsigns.
    Is it just me, or has QRZ stopped updating the page that lists new FCC updates by callsigns?
    K0OU Steve in KC
     
  10. AC3P

    AC3P Ham Member QRZ Page

    Jeez! Aren't there mote important things to complain about?

    I remember a time when people had to wait almost six months to get their ticket to operate. Believe me, the process is much better today.

    If one is in a big hurry to find his/her new call, just check the ULS database directly. As a VE, I tell the applicants at my test sessions to do just that. I give then URLS for all the major look-ups plus the ULS.  If they don't have the internet, I will do look-ups myself and let them know when they are on the FCC database.

    73 and Congrats to all who got a new ticket or upgraded.

    Frank AC3P
     
  11. KE4PJW

    KE4PJW Premium Subscriber QRZ Page

    </span><table border="0" align="center" width="95%" cellpadding="3" cellspacing="1"><tr><td>Quote (w7arc @ April 13 2002,03:34)</td></tr><tr><td id="QUOTE">If you are worried about whether or not you're upgrade or license has been processed, why not check the source? QRZ and the rest of the Call Sign Servers get their information from the FCC and you can check them anytime at http://www.fcc.gov/wtb/uls The lastest information is always there.

    73 W7ARC
    Silverdale, WA[/QUOTE]<span id='postcolor'>
    When I click on "Search" all I get is "This plug-in only runs on Windows NT/95." Gotta love big government, they sue Microsoft for being a monopoly and turn right around and help them keep their monopoly.
    [​IMG]
    QRZ and other call sign servers are the only way some of us can do lookups because the FCC has chosen to make a custom Windows plug-in rather than simply allow people to do lookups via a web browser.
     
  12. KG4KKN

    KG4KKN Ham Member QRZ Page

    IIRC, it's actually trying to load a Sun Java engine, not a Microsoft plugin.

    As noted earlier, Amateur Radio is a low priority for the FCC and programming is probably about as low, so Java was what they came up with for everyone using the ULS.

    As the saying goes, you get what you pay for.
     
  13. WI7L

    WI7L Ham Member QRZ Page

    I recently tried to apply for a vanity call, this during the backlog period, and found that I couldn't get through to the FCC site on my work computer. After many attempts, I finally mailed in my application and started checking QRZ.com for the results. Sure enough, even before I expected it, my new call showed up. I don't know about how everyone else feels, but as far as I'm concerned, Fred is doing one heck of a fine job with what our "friends" at the FCC give him. Thanks for the FB from this end.

    73s
    Lee
    WI7L
     
  14. KE4PJW

    KE4PJW Premium Subscriber QRZ Page

    </span><table border="0" align="center" width="95%" cellpadding="3" cellspacing="1"><tr><td>Quote (kg4kkn @ April 14 2002,15:22)</td></tr><tr><td id="QUOTE">IIRC, it's actually trying to load a Sun Java engine, not a Microsoft plugin.

    As noted earlier, Amateur Radio is a low priority for the FCC and programming is probably about as low, so Java was what they came up with for everyone using the ULS.

    As the saying goes, you get what you pay for.[/QUOTE]<span id='postcolor'>
    No, it is not a Java [tm] plug-in. If it were, it would run cross platform, just like all Java [tm] plug-ins do.

    The ULS is used by all radio services, including Amateur Radio.

    For my tax money, I want something that works. As QRZ.COM demonstrates, the plug-in is not needed and therfore a waste of my tax money.
     
  15. KG4KKN

    KG4KKN Ham Member QRZ Page

    Reply sent privately....

    </span><table border="0" align="center" width="95%" cellpadding="3" cellspacing="1"><tr><td>Quote </td></tr><tr><td id="QUOTE">No, it is not a Java [tm] plug-in. If it were, it would run cross platform, just like all Java [tm] plug-ins do.

    The ULS is used by all radio services, including Amateur Radio.

    For my tax money, I want something that works. As QRZ.COM demonstrates, the plug-in is not needed and therfore a waste of my tax money. [/QUOTE]<span id='postcolor'>
     
Thread Status:
Not open for further replies.

Share This Page

ad: wmr-1