|
|
??????????????(??)
???
7??????
?????? 10 ????? 20 ?.
1. ?????X?Y?????????H(X|Y)?????H(X). ? ?
2. ???????????????????????
1??X??0
?P(X)???1/21/2???????????
?0a?
??????Dmax= D????a0?
????? 4 ????? 50 ?.
1????????2???xi(i?1,2),p(x1)?a????
???????????????.?? y( j ? 1 ,2) ???????? ?3 ?,3?? 3.??????????????????????????. ? ?
4. ??????????????????????????????????????????????
?
? ? 5. ????????????????????????????????. ? ? 6. ?????????????????. ? ?
7. ???????????????????????????????????????????????????. 8. ???????????. ? ? 9. ??????????0
. ? ?
10.?????????????????0. ? ?
?????? 6 ????? 20 ?.
1
?
?
?
?
?
?
?
?
?
?
?
? .
2????????????? .
3???????????????k??(n,k)???? .
4??????????????
???. 5?????????????????X?Y??
I(XN,YN)?NI(X,Y)???
??
6?????-?????????-??????????????????? .
iP???1/21/20?
?1/21/41/4?. ?
?1? ??????????
??H(Y)? ?2? ??????????
???H(Y|X)? ?3? ??????????????. 2??????????????
?2-13
??????? ??X?????{0,1,2}. ?1?????????????
?2????????
? 3 ??????????????????????? ? X )
???.???????H(??H?????.
4 ??? ?( 7 , 4 ) ?
????????????1101000?G??
0110100???1110010??
. ?1010001?
?
?1????????????????????????????????
?2??????v?(0001011
)????????????S???????????
??????. ???
???????15????1??
1??????????? ??????????? ?
2?????????????????? ??
?? XY
3??????????? ?????? 4????????????????????? ?
5?????????????? 6?????????????????????
? ?
7?????????????????
? ?
8?????????????????2????????
?????? ?????????????? ? 9????????????????,?,?,???
?1??X?Y??????H?XY?H(X)+H(X/Y) H(Y)+H(X)?
?2?H??H?X1X2?
H?X1X2X3?2?X2H3?X??3
?3????????X????????Y????????????H(X/Y) 0,
H(Y/X) 0,I(X;Y)H(X)?
???16??????
??S??s1s2s3s4s5s6??P?????0.20.20.20.20.10.1??
?1??????????????????6?? ?2???????L;?4??
?3????????R?;?2??
?4???????????R;?2?? ?5??????????2??
???10???????A?B?C?D?E??????????????????????1/8?1/8?1/8?1/2?1/8???????????0.5?s???? ?1???????Rt??5??
??(16?)????????????????
P?S|S23|S1
11??,P?S21??3
,P?S1|S2??1,P?S2|S2??0?
(1) ????????(4?)
(2) ???????(4?)
(3) ?????????????(4?)
(4) ?????H1,H2?????????(4?) ???????????????????????????????
??(16?)?X?Y?????????????????0?1?????????????????Z=XY(????)???? (1) H?X?,H?Z?;
(2) H?XY?,H?XZ?;
(3) H?X|Y?,H?Z|X?;
(4) I?X;Y?,I?X;Z?;
??(10?)??????????????
??X????x1x2?
P?0.80.2???????????????????????
??Y??y1,y
2??????????????
x1
y1
x2
y2
(1) ????X???x1???????? (2) ????X????? (3) ???????H?X|Y?? (4) ?????H?Y|X??
(5) ??????Y???????????
???????2????
???????15????1?? 1????????????????????????????????? 2??????????????????????????????????????????
3???????????0?????log3
2 4??????????????????????????H(S)/logr= Hr(S)??
5??R=C????????0????????????? 6??????????????????????????????? 7?????????????????????????????????
8?????????????????2
????????2????????????????f?
x??
2??x??
????????????1
log2?e?22
?
9????????????????,?,?,??? ?1??X?Y??????H?XY?=H(X)+H(X/Y)=H(Y)+H(X)?
?2?HH?X1X2?
H?X1X2X3?2?X??2?H3?X??
3
?3????????X????????Y????????????H(X/Y)> 0, H(Y/X)=0,I(X;Y)<H(X)? ???16??????
??S??????s1s2s3s4s5s6?
P??0.20.20.20.20.10.1??
?1??????????????????6?? ?2???????L;?4??
?3????????R?;?2??
?4???????????R;?2?? ?5??????????2??
?1?
S10.200
S20.21S1.030.20
S140.21
S0
50.11
S6
0.1
1
??????
S1?00S2?01S3?100S4?101 S5?110S6?111
6
?2?L??Pi?i?0.4?2?0.6?3?2.6??
i?1
?3?R??logr=2.6
?4?R?
H?S?
?
2.53
?0.973bit2.6
???H?S??H?0.2,0.2,0.2,0.2,0.1,0.1??2.53
?5???
H?S??S?logr
?
H?0.973
?????????????1??????? 2?????
?? ???10???????A?B?C?D?E??????????????????????1/8?1/8?1/8?1/2?1/8???????????0.5?s???? ?1???????Rt??5??
?1?R1
t?t??
H?X??H?X?
??
H?X???
18log18?4?112log2?1log8?1
log2 22
?31
2log2?2log2?2log2?2bitR?2bitt?s
?4?1060.5bps
??(16?)????????????????
P?S21
1|S1??3,P?S2|S1??3
,P?S1|S2??1,P?S2|S2??0?
(1) ????????(4?)
(2) ???????(4?)
(3) ?????????????(4?)
(4) ?????H1,H2?????????(4?) ??(1)
1
(2)???P?Si???2
P?Si
|Sj
?P?Sj
?
j?1
?
?
2
?P?S1??PS|SPS?2P?S1??P?S2?
??1i??i??i?13?2
?
P?
?S1
2???P?S2|Si?P?Si??P?S1? i?13??P?S1??P?S2??1?
?
P?S??3???1?4
???P?S12
??4
(3)?????????????
22
H?????P?Si?P?Sj|Si?logP?Sj|Si?
i?1j?1
??34?23?log2311
3?4?3?log
3?1
2?0.578?1
4?1.599?0.681bit???0.472nat???0.205hart(4)?????
2
???P?x?3
311?i?logP?xi???i?1
??4?log4?4?log4???0.811bit??
H2?H??0.205hart???0.472nat?0.681bit
???????
??H10.811
1?1H?1??0.189
0???1?2log??1?1?1??
?2???2log??2????
?2?1?
H20.681H?1??0.319 0???1?1?2log???2???1?1??
2log??2????
???????????????????????????????
X
Y
??????????
??1
1?2200???011?P220??Y|X
????1??001 ?22???11??2
2??
?????????????L=4,???????
C?log4?H??11?
?2,2,0,0?
?
L
?logL??p?yj|xi?logp?yj|xi?
j?1
?log4?2?11
2log
2
?1bit
??(16?)?X?Y?????????????????0?1?????????????????Z=XY(????)???? (1) H?X?,H?Z?; (2) H?XY?,H?XZ?; (3) H?X|Y?,H?Z|X?; (4) I?X;Y?,I?X;Z?;
H?X??H??1?2,1?
2???1bit
H(2)?H??3?4,1?
4??
?0.8113bit
(2) H?XY??H?X??H?Y??1?1?2bit?
H?XZ??H?X??H?Z|X??1?11?12H?1,0??1?
2H??2,2??
?1.5bit?
(3) H?X|Y??H?X??1bit
H?Z|X??
112H?1,0??2H??11?
?2,2??
?0.5bit
(4) I?X,Y??H?Y??H?Y|X??H?Y??H?Y??0 I?X,Z??H?Z??H?Z|X??0.8113?0.5?0.3113bit
??(10?)??????????????
??X??x1x2?
?P?????0.80.2????????????????????
??Y??y1,y2??????????????
x1
y1
x2
y2
(6) ????X???x1???????? (7) ????X????? (8) ???????H?X|Y?? (9) ?????H?Y|X??
(10) ??????Y???????????
??
(1) I?x1???log0.8?0.322bit?0.0969hart?0.223nat (2) H?X??H?0.8,0.2??0.722bit?0.5nat?0.217hart?? (3)
H?XY??H??2?3,215,320,1?
20?
??1.404bit??
?0.973nat?0.423hartH?Y??H?49/60,11/60??0.687bit?0.476nat?0.207hart??
H?X|Y??H?XY??H?Y??0.717bit?0.497nat?0.216hart
(4)
H?Y|X??H?XY??H?X??0.682bit?0.473nat???0.205hart??
(5)
I?X;Y??H?X??H?X|Y??0.00504bit???0.00349nat???0.00152hart
(?)
?? ?????10?????2??
1??????????X???????
??X??x1
x2x3x4??P?????0.50.250.1250.125????????????????H(X2)=( ) A?1.75??/??? B?3.5??/??? C?9??/??? D?18??/??? 2????????
??P(1y/1
x)2
P(
1
y/x)0
??00P3
y(/?2x4P)2y(x??0
0P?
50y3x??
??P(yj/xi)???????????
3?A??????????
B???????????? C?????
D????????????
3???????C????????????
A??????????C B?????????C
C???????????C D?????????C
4?????????????????
A????? B????? C??? D????
5??BSC???????P??????????? A?
H?p?
p
log?1?p
?2??1?B?
?p??p?
??
??????????????
??? ????????
???11????
?1? 1948??????? ???????????????????????
??????
?2? ????????? 0 ?
?3? ?????????X?N?????????????X??? N? ?
?4? ?????????????????????????__????????_?
?5? ????????
?????H?X?
??2.5?????
????????
????????
?????
?
?6? ?????????????????????????? ?????
?7? ????????????????3????????????_2_______??????
?????___1__??????
?8? ???????????????????C????????????R__??___C??
??????????
???????????????n???????????????
?9? ???????????????????????___????____________?___???
?___??
???9?????
?1? ????????? ? ??
?2? ????????????????????????????????????????
?? ? ??
?3? ???????????? ? ??
?4? ??????????????? ? ?
?5? ???????????????????????????????????????? ??
?6? ????????????????????????????? ? ??
?7? ??????????????????????????? ? ? ?
?8? ???????????????????????????????????????
? ? ?
?9????????R(D)????????D?????. ( ?)
???5?????????????25%????????????75%???1.6???????????1.6???????????
????????1.6???????????????????????? ???A??????????B????1.60????????
P(A)=0.25 p(B)=0.5 p(B|A)=0.75?2??
?p(A|B)=p(AB)/p(B)=p(A)p(B|A)/p(B)=0.75*0.25/0.5=0.375?2??
I(A|B)=-log0.375=1.42bit ?1??
???5???????????????????
I(X;Y)=H(X)+H(Y)-H(XY)
???
I?X;Y????p?xiyj?log
XYpxiyjpxi??
????????p?xiyj?logp?xi??????p?xiyj?logpxiyj??2??
XY?XY?
?H?X??H?XY?
??
I?X;Y??H?Y??HYX ?1??
? ??
HYX?H?Y??I?X;Y?
??
H?XY??H?X??HYX ?1??
? ????
H?XY??H?X??H?Y??I?X;Y?
?
I?X;Y??H?X??H?Y??H?XY? ?1??
???18?.??????????????????????
1? ????????0.3?????????0.7??????????????X?????????????????????????H?X??
2? ????????????????????
?????H??X?? ?
?3???????????????????????????????
??1?????? ?1??
?2??
2??????????????????? ?2??
?
?4??
???????
?2??
?3??
3?
?1?1?H(X)?0.119log22 ?1??
H?(X)?0.447log22?1?? ?2?1?
?2??1????????????????????????????????????????????????????????????????????2??
???18?.?????
x2x3x4x5x6x7?X??x1??P(X)??0.20.190.180.170.150.10.01???
?????????????????????????
???????????????????
L??p(ai)li?3.14i?17R?H(X)2.61??0.8313.14L
??????????????????? 2
1.?????????????X?{a1,a2,a3}?
???S?{S1,S2,S3}???Si?ai,i?1,2,3????????
?
?
??442?
P(a?3??(1)????????????? j/Si)??30?
???
(2)????????? ??(1)
??w1?w2?w3?w1?4w1?3w2?3w3?w2?w1?0.4
?2???2w1?3w2
?w3??
?w2?0.3
???
w1?w2?w3?1?w3
?0.3H(X|S1) =H(1/4,1/4,1/2)=1.5??/?? H(X|S2)=H(1/3,1/3,1/3)=1.585??/??
H(X|S3)=H(2/3,1/3)= 0.918??/??
H???3
wHX|S?0.4?1.5?0.3?1.585?0.3?0.918?1.351??/?? i?1
i?i
?
?????
????7?4??
c?(c6c5c4c3c2c1c0)?(m3m2m1m0c2c1??????????
??
c2?m3?m1?m0?c1?m3?m2?
m?1 ?c0
?m2?m1?m
0?1???????????????
?2???????????
?3????????????????? ?4??????R=1110011?????
c0)?????
?1?0
??1. G??
?0??0
0100
0010
0001
1011
1?0
?1
1?1? H??1
?1?1
???0
0?1
011111101100
0?01? ? 00??1
2. dmin=3 3.
4. RHT=[001]????
E=0000001 R+E=C= 1110010 (??)
?????
???X,Y??????p?x,y??? ?H?X??H?Y??H?X,Y??I?X;Y?
X01
01/30
11/31/3
?1/ 3 ?: p(x?0)?2/3 p(x?1)p(y?0)?1/3 p(y?1)?2/ 3
H?X??H?Y??H(1/3,2/3)?0.918 bit/symbol H?X,Y??H(1/3,1/3,1/3)=1.585 bit/symbolI?X;Y??H(X)?H(Y)?H(X,Y)?0.251 bit/symbol
?1/21/31/6?
???? ?????????????PY|X??1/61/21/3?????????????1/31/61/2??
?PX???0.5
0.250.25???????????????????????????
???????
?1/41/61/12?????[PXY]?1/241/81/12 ????1/121/241/8??
?F(b1)?a1
?
????????F(b2)?a1???????1-1/4-1/6-1/8=11/24?
?F(b)?a
33??F(b1)?a1
?
????????F(b2)?a2???????1-1/4-1/8-1/8=1/2
?F(b)?a
33?
???????
x2??X??x1
????1?????????????????? ????
?PX??1/43/4?
?2? ??????????????? ?? ?1?
H(X)?1/4log24?3/4log2(4/3)
??H(X)/log22?H(X)??1???1?H(X)
?2??????????????
H(XX)?1/16log216?3/16log2(16/3)?3/16log2(16/3)?9/16log2(16/9)
4,.?????
x2x3x4x5x6x7?X??x1
??P(X)??0.20.190.180.170.150.10.01
???
????????????????????
?
???????????????
?????
??BSC??????????? ?1?????????? ?2????????????
?? ?1?
1
???1?????(1??)2??2?1??
P?PP??12?????1?????1????2?(1??)??
2
2
2?(1??)?
22?(1??)???
?2?C?log2?H((1??)??)
?000111??
011001???18?????????????????H??????101011??
1??????n=?,k=???????? 2???????????G?
3?????????????
4????????101001???????????????
??1?n=6,k=3,??8?????3?? 2????
?
C??C5C4C3C2C1C0?
?HC
T
?0T?
?????
?C2?C1?C0?0?
?C4?C3?C0?0?C?C?C?C?0
310?5
?3??
?C2C1C0????
?C2?C5?C3
?
?C1?C5?C4?C?C?C
43
?0 ?3?? ?100110?
?010011????001101?? ?2?? ??????
3??????000000?001101?010011?011110?100110?101011?110101?111000??4??
4??S?HR?
T
T
S??101???2???????5???????101001?????101011??????
?101001??1??
?? 1.????????
???????????????????????????????
?????
???Y???????X???????????X??Y????????????????????????????????
????????????2????????
?????http://www.850500.com/news/6446.html
?????,??! |
|
发表于 2019-9-13 23:46:11