Data validation
The rules by which the book argues with a record
An open list: what is checked, why it is an error, and what to do about it. Rules are stated in advance — like an exam syllabus, not a remark after submission.
rules in the registry
find a contradiction in the data
report that data is absent
draw attention without holding up confirmation
carry a numeric limit stated aloud
Three states, and “fix it” is not among them
A check never asks you to fix a record, and that is not politeness. By construction it cannot tell a correction from a fudge: a rule saying “yield of 45,000 kg is out of bounds” would, at the word “fix it”, invite someone to put 12,000 — the block lifts, the mark of the Association goes on, and the book records a number nobody ever measured. So a check names the state of the record, and the decision stays with people.
There are three states. “Data missing” — the fields are empty: no date of birth, no breed, not a single parent. There is nothing to fake here, and the only way on is to upload what is absent. “Data does not add up” — the data is there and contradicts itself: a calving before the birth, DNA that rules out the recorded sire, a blood share above one hundred per cent. Here editing the record is precisely the thing that must not be done without grounds. “Worth a look” — the rule has noticed something odd and may be wrong.
The difference between the second and the third is not one of strictness but of whether the rule itself can be wrong. “Parent younger than offspring” cannot be wrong — it is a contradiction. “Yield above twenty-five thousand” can be: such a cow is rare but possible, and forbidding her would mean vouching for what we do not know.
What happens to a record that has questions against it
Nothing is deleted and nothing is rolled back: the data stays in the book, and the farm sees it and edits it. What is held is something else — the confirmation of the Association, the very mark the record is kept for. Until a finding has been dealt with, the animal is not confirmed and does not count as pedigree by the book.
How it is lifted differs. “Data missing” is lifted by uploading what is absent — and by nothing else. “Data does not add up” is lifted by an explanation the expert accepts: a document, a laboratory certificate, a letter from the farm saying where the discrepancy came from. The expert may judge a finding immaterial and waive it — but the waiver is by name, for this record and this rule, and it stays in the history of the application.
The third outcome is lawful too: to accept that the animal does not count as pedigree. The book is under no obligation to confirm everything uploaded into it, and a record without confirmation is not a defect but an honest statement of where things stand.
What the book asks for besides consistency
The rules below check the data against itself. Apart from them the book looks at completeness: confirmation means not only “no discrepancies” but also “everything required has been submitted”. The list is short and the same for every application.
Without these a record is not confirmed:
- date of birthage at first calving, lactation numbers and pedigree checks are all counted from it
- breedwithout a breed the record cannot be compared with contemporaries or put into reports
- sire: a record in the book or a number from the documentsthe book confirms parentage; with no sire there is nothing to confirm
- dam: a record in the book or a number from the documentswithout a dam the maternal line breaks and offspring inbreeding cannot be computed
- at least one calvinga cow without a calving is either not a cow or a history that has been lost
- test-day recordings (at least 6 if a 305-day yield is claimed)a 305-day yield with no measurements is a number taken from nowhere
The list
Every rule has a number, and the number is what to quote in a letter or in a conversation with support: rule 45. It reflects the place of the rule in the registry and shifts if a new rule is inserted in the middle; the permanent key is the code of the rule, which goes into exports and never changes.
contradiction: 36rules in the registry
Passport2 rules
Fields of the record itself: identifier, date of birth, breed, breed percentage.
1.2Date of birth in the future
contradictionThe date of birth is later than today.
Usually the day and the month have been swapped, or the year is wrong.
1.4Breed percentage out of range
contradictionThe breed percentage is below zero or above one hundred per cent.
A share of blood is a part of a whole and cannot go beyond one hundred per cent.
Parentage10 rules
Parents, the pedigree and everything computed from it. An error here costs more than the rest: it does not spoil one record, it distorts the evaluation of every descendant.
2.1Animal appears among its own ancestors
contradictionWalking up the pedigree leads back to this same animal.
Traversal of the pedigree loops at that point. The inbreeding computation survives it — there is a guard in place — but at the cost that the true coefficient cannot be computed either for this animal or for any of its descendants.
2.2Impossible parent age
contradictionAt the birth of the offspring the parent was younger than 19 months or older than 20 years. Animals produced by embryo transfer are left out of this rule entirely.
Younger than nineteen months is physically impossible: gestation lasts about 279 days. Older than twenty years is almost always a link to the wrong animal — to a namesake, for instance. With an embryo transfer the age of the donor has to be counted at the day the embryo was collected, not at the birth of the calf: the herdbook has no such field yet, so the rule stays silent and the report says on how many records.
2.3Dam gave birth twice in a row too quickly
contradictionOne dam has two offspring less than 270 days apart, and it is not a twin birth. Offspring produced by embryo transfer are not counted.
A cow cannot carry two calves faster than gestation lasts. Either one of the offspring is recorded under the wrong dam, or it is a twin birth entered as two separate calvings. An embryo donor is under no such constraint: she carried none of her offspring — different recipients did — and the gap between their births can be anything.
2.4Dam has more offspring than her life allows
contradictionThe number of litters recorded for one dam exceeds what she could have produced between her earliest possible calving and the birth of her last recorded offspring. Twins count as one litter; offspring produced by embryo transfer are not counted at all.
This is what a merge looks like: two or three different animals with similar numbers collapsed into one record, with all their offspring recorded under a single cow. Per-record rules cannot see such a merge — each link is plausible on its own, and it is their sum that is impossible. Nor is the error a single one: the pedigree of every one of those offspring is wrong, and with it their blood share, inbreeding and evaluation.
2.6Animal recorded as its own parent
contradictionThe sire or dam field holds this same animal.
Traversal of the pedigree loops on such a record, and the inbreeding coefficient cannot be computed.
2.7Parent of the wrong sex
contradictionA female is recorded as the sire, or a male as the dam.
Most often the sire and dam fields were swapped during entry.
2.8Parent younger than the offspring
contradictionThe parent was born after the offspring, or on the same day.
A direct contradiction: usually the link points to the wrong animal — to a namesake, for instance.
2.10Pedigree on paper disagrees with the link
contradictionThe parent identifier copied from the certificate differs from the identifier of the animal the link points to.
The pedigree is stored twice: as a link and as text from the document. While the two agree it is a safeguard; once they diverge, one of the two is wrong, and only the farm knows which.
2.13High inbreeding
contradictionThe inbreeding coefficient exceeds the limit that has been set.
A value like this comes from close mating and calls for parentage confirmed by documents.
2.14DNA test excluded the parentage
contradictionThe test did not confirm the parentage, yet the parents are still on the record.
A direct contradiction between the document and the record — and the only case in which the system knows for certain that the pedigree is wrong.
Reproduction12 rules
Calvings and inseminations — not one by one, but as a sequence in time.
3.1First calving too early
contradictionThe age at first calving is under nineteen months.
Gestation lasts about 279 days, so such a calving would have required conception before puberty. This is an error in the date; there is no other explanation.
3.3Two calvings marked as the first
contradictionNumber 1 stands on several calvings of one cow.
The calving number runs through the whole life of a cow; there is only one first.
3.4Calvings out of order
contradictionA calving with a higher number carries an earlier date than the one before it.
Every value on its own is plausible; only their order is impossible. Usually the numbering was mixed up when the data was carried over from the previous recording system.
3.5Calving interval shorter than gestation
contradictionThe interval between neighbouring calvings is shorter than two hundred and seventy days.
A cow cannot calve twice faster than gestation lasts. Either the date is wrong, or the second entry records an abortion.
3.7Event recorded twice
contradictionOne animal has two identical events on one date: two calvings, two inseminations or two test-day recordings.
Usually the same file was uploaded twice. Until the duplicate is removed, every average for the animal is computed on doubled data and the calving numbers run ahead.
3.8Insemination too soon after calving
contradictionFewer than twenty days between the calving and the insemination.
Before the twentieth day the uterus has not recovered, and there is physically nothing to inseminate. This is not bold management but an error in the date.
3.9Pregnancy check earlier than the insemination
contradictionThe date of the pregnancy check falls before the date of the insemination itself.
The order of events is reversed: there is nothing to check before the insemination.
3.10Bull born after the insemination
contradictionThe service sire recorded on the insemination was born after its date.
The link points to the wrong animal — as a rule to a namesake, or to a match on a short identifier.
3.14Two calvings under one number
contradictionAn animal has several calvings with the same number — two third calvings, for instance.
The calving number runs through the life of a cow and cannot repeat. A repeat means either a doubled upload or a slipped link: the calving was recorded against the wrong animal. The second is the more dangerous — the event disappears from one cow and appears on another, and the number of calvings, from which the lactation number and the age group are derived, lies for both.
3.17Gestation length outside the plausible range
contradictionFewer than 265 or more than 295 days lie between the fruitful service and the calving. With an embryo transfer the count starts at the day of transfer, and both bounds are a week lower.
Gestation in Holsteins lasts about 279 days and varies within a week. Shorter than 265 days is usually a slip in the calving date, or an abortion entered as a calving. Longer than 295 usually means the wrong service is marked as the fruitful one, or a later service never reached the herdbook.
3.18Calf recorded elsewhere than where the dam calved
contradictionThe offspring of a calving is held by a different farm or herd than the dam was on the day of that calving.
A calf is born where its dam stands. A divergence means one of two things: either the calving is recorded under the wrong cow, or the calf was moved and the movement never reached the herdbook. Location is an independent witness: a date in a record is changed with one keystroke, while a move leaves a trace with the other party.
3.19Natural-service bull stood on another farm
contradictionThe mating is recorded with a bull who on that day was held by a different farm — or on a different site of the same farm — than the cow. Artificial inseminations are outside this rule.
Natural service requires the bull and the cow to stand together. A bull from another farm means either a link to the wrong animal — usually a namesake — or an unrecorded lease of the bull.
Production8 rules
Milk yield, fat, protein and how well they agree with one another.
4.1Milk yield outside the plausible limits
contradictionLactation yield below five hundred or above twenty-five thousand kilograms.
Twenty-five thousand occurs in world record holders, forty thousand in no one. Limits drawn this wide catch an error in the unit of measurement without touching a good animal.
4.2Fat outside the plausible limits
contradictionFat content outside the range from two to six and a half per cent.
Beyond these limits it is usually not fat content but swapped columns.
4.3Protein outside the plausible limits
contradictionProtein content outside the range from two to five per cent.
The same again: beyond the limits lie swapped columns, not a record.
4.4A bull has production of his own filled in
contradictionThe record of a bull carries milk yield, fat, protein or lactations, as a cow record would.
A bull has no production of his own: there is nothing to milk. The figure got there from someone else’s spreadsheet or from a wrongly entered sex, and it spoils any herd average the bull enters alongside the cows.
4.9Fat kg evaluation disagrees with the yield and percentage evaluations
contradictionThe breeding value for fat in kilograms differs by more than one standard deviation from what follows from the evaluations for yield and fat percentage.
Kilograms in an evaluation are not an independent figure: they follow from the yield and the percentage. A divergence means the figures were assembled from different sources — and what goes into the index is something the animal does not have. Each figure on its own is plausible, which is why the plausibility limits do not see this error.
4.10Protein kg evaluation disagrees with the yield and percentage evaluations
contradictionThe breeding value for protein in kilograms differs by more than one standard deviation from what follows from the evaluations for yield and protein percentage.
The same as with fat, and more dangerous: protein carries fourteen per cent of the weight in the Association profile, and its spread is three times narrower than that of fat. Forty extra kilograms of protein pull an animal into the top one per cent of the book.
4.12Age group disagrees with the sex
contradictionA male animal carries a cow age group — first-lactation cow, cow in second lactation or cow in third and later.
One of the two fields is wrong, and from outside it is not visible which. If the sex is wrong, the animal counts as a cow in every report by group and can be given a calving. If the group is wrong, a bull falls into selections of cows and spoils their averages. The system does not choose on behalf of the person: all it knows by itself is that these two values cannot exist together.
4.13Production on an animal that has never calved
contradictionAn animal in the calf or heifer group has milk yield, fat, protein or lactations filled in.
There is no lactation before the first calving — there is nothing to milk. Either the age group is out of date and the animal calved long ago, or the production row arrived from another animal. The first spoils reports by group, the second the evaluation of a bull on his daughters.
Status and disposal3 rules
Whether the status of an animal agrees with what is recorded about it.
5.1Age too high for an animal listed as in the herd
contradictionThe animal is older than the age limit and is still listed as alive.
Almost always it means that a disposal was never recorded, not that the cow lived to a record age.
5.2Disposal stated, yet the animal is in the herd
contradictionA disposal reason is filled in while the status has stayed as in the herd.
The animal keeps appearing in herd lists and counts, having left the herd everywhere except on paper.
5.5Event recorded after the disposal
contradictionThe animal has a test-day recording, an insemination, a calving or a weighing dated later than the day of disposal.
A cow that has left is neither milked nor calving in this herd. Usually it means one of two things: the disposal date is entered wrongly, or the event was recorded against the wrong animal. The second is the more dangerous — the event has disappeared from one cow and appeared on another, and both of them lie.
Comparability across the herd1 rule
The only group where a finding belongs not to a record but to the herd as a whole. Every record here is faultless on its own — the trouble is that together they were obtained in different ways and cannot be compared with one another. That is why they are computed over the whole herd rather than over the submission: a share computed from a sample would call itself a share of the herd and would lie. They are visible in “Check my herd” and to the expert reviewing a submission; they do not block submission.
6.1Milk yields entered in different units
contradictionThe herd holds records where the yield differs from the rest by two orders of magnitude: some in kilograms, some apparently in tonnes or centners.
One by one such records are caught by the plausibility check, and the farm sees fifty identical warnings instead of one cause. While the units differ, any herd average and any comparison between animals is meaningless.