|
1. |
The average amount of information lost in multiplication
Pippenger, N.;
Information Theory, IEEE Transactions on
Volume 51,
Issue 2,
Feb. 2005
Page(s):684
-
687
Abstract:
We show that if X and Y are integers independently and uniformly distributed in the set {1,...,N}, then the information lost in forming their product (which is given by the equivocation H(X,Y|XmiddotY)), is Theta(loglogN). We also prove two extremal results regarding cases in which X and Y are not necessarily independently or uniformly distributed. First, we note that the information lost in multiplication can of course be 0. We show that the condition H(X,Y|XmiddotY)=0 implies 2log2N-H(X,Y)=Omega(loglogN). Furthermore, if X and Y are independent and uniformly distributed on disjoint sets of primes, it is possible to have H(X,Y|XmiddotY)=0 with log2N-H(X) and log2N-H(Y) each O(loglogN). Second, we show that no matter how X and Y are distributed, H(X,Y|XmiddotY)=O(logN/loglogN). Furthermore, there are distributions (in which X and Y are independent and uniformly distributed over sets of numbers having only small and distinct prime factors) for which we have H(X,Y|XmiddotY)=Omega(logN/loglogN)
|
Cart
