Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
� � ������� �
� �� � ����������� ����������������
� �!��"#�%$ � &'�)(�(+*-,.�0/1����, (����2�3���4��� 5���687�(��:9
<; � �0=>��9 5�(��8?@(4������������� "A6 5�(%�B �C�����ED2�)�C$
� �!��" FHG���$I"I��6��!$ $J��68G�(%, &'� �8$�D ��7K6�G�" � �8�C��������L���2�3���4����
M NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
��� ����� ��� � � ���!� ��� �
� ��� �)� " 5���68�8����$�$ �4� �2(��868����"I��9 $ ��� , "I���:68�3
� �36 &#����� �!6 6 , 6�� 68��(4����� ,��2"��
� 6�9 5�G�"��2"I��68�!�2( 5K6 &'�)�#�%$ ��� �2��(%��7�(4� � G!,�,>����� ���!,.G $J"I��
� �����)� ���%������$�� 6�� 9 �8�C������� (���������������?
� ��"�� 9 �4������� ? G!$I����� ���%$I"I68���%�)��( ,���"�� "I6 ��9 5���6����,.��� �%$I��68� $
� 9 ��,>�%�)��( ����� 6��C,�$ � 9 �B,.�%�)��( DH��6 &#(���,>�8�
� 6�� "-&������ �25�5�(��%�:��"I��68� $ &'� �:�����c" 5��368���C��9 7 � ���!,
� ��G�"A68��689 6�G!$#,.�3��� ������ $I5K�)����� ����� 68������"I��6��
� �)(�� � G!$I"I689 �! :����� 5���68�8�x��9 $
� " �)& $I�3����,.�)� "I� ��"#(��������!$ G!$J�:� �4��"I�)����$I"�$
# NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � � � � � ��� ��� � � � � �����
� �2"��.?
Patient103 Patient103Patient103 ...time=1 time=2 time=n
Age: 23
FirstPregnancy: noAnemia: noDiabetes: noPreviousPrematureBirth: no
...
Elective C−Section: ?Emergency C−Section: ?
Age: 23
FirstPregnancy: noAnemia: no
PreviousPrematureBirth: noDiabetes: YES
...Emergency C−Section: ?
Ultrasound: abnormal
Elective C−Section: no
Age: 23
FirstPregnancy: noAnemia: no
PreviousPrematureBirth: no
...
Elective C−Section: no
Ultrasound: ?
Diabetes: no
Emergency C−Section: Yes
Ultrasound: ?
� �!���)� ?
��� �� 5!��"A���)��" �3���068�C,�$��>���8�C� ,.��$�� �3�47������ �5��3�:�8�!���!�0 ��� , 7�����"I�
��'�8�C� 5!�2"I���)� " �3�B� 68�x, �068��"��2���!$ �� �� � ����"IG��3��$��������� "I6 5��3��,>�%� ")?
� ( �8$3$I��$ 6�� � G�"IG���� 5 ��"I���)� "�$ ��"#�����8� ���%$�D � 68�� 9 �:�3�8�:�!� � ��$���������� � ��� "A��68�
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � ��� ��� ��� � � � �>� ���
� �2"��.?
Patient103 Patient103Patient103 ...time=1 time=2 time=n
Age: 23
FirstPregnancy: noAnemia: noDiabetes: noPreviousPrematureBirth: no
...
Elective C−Section: ?Emergency C−Section: ?
Age: 23
FirstPregnancy: noAnemia: no
PreviousPrematureBirth: noDiabetes: YES
...Emergency C−Section: ?
Ultrasound: abnormal
Elective C−Section: no
Age: 23
FirstPregnancy: noAnemia: no
PreviousPrematureBirth: no
...
Elective C−Section: no
Ultrasound: ?
Diabetes: no
Emergency C−Section: Yes
Ultrasound: ?
� ��� 6�� �� (����2�3���B, ��G�(��B$ ?
��� �� ��� ���������� ������������� �� ������� ��!#" �$���% &'�(�)��*���� +$��� ,����-*� ���.� � /0�$.����������'���1" �$���2�������� ��� $��.���.������ ��. � ��*3�'�'�'�����
, 4� $� 5����&��$&�������.'! �)� 6$*� ���� $��7�! 89 :' �7�.������ �'� ;1<>=
? �� � .�������������� ����.��1@ +'=�A$B3C D <>='EF"? �� � .� ���. ����.��1@ C�+�A +'; D <>=';
G NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� ���� ��� � � � � � � � � � �.� �
� �2"��.?
Customer103: Customer103: Customer103:(time=t0) (time=t1) (time=tn)...
...
Own House: Yes
Other delinquent accts: 2
Loan balance: $2,400
Income: $52k
Max billing cycles late: 3
Years of credit: 9
Profitable customer?: ?
...
Own House: Yes
Years of credit: 9
Profitable customer?: ?
...
Own House: Yes
Years of credit: 9
Loan balance: $3,250
Income: ?
Other delinquent accts: 2
Max billing cycles late: 4
Loan balance: $4,500
Income: ?
Other delinquent accts: 3
Max billing cycles late: 6
Profitable customer?: No
� G�(4��$<(4����������, � �3689 $I ��"A����$I�! )��, ,���"��.?
��� ? . 4� �9��� ����������� $��.�9$% 7'7����'�.�� � +F" �$�������*�&� �9��� ����������� $��.�9����'��������9)8�! 7�� �� � C
, 4� $� 5���)����.��$&(� �9)8�����.���*� ��� D �� �� $��! 8'�� ����. 8�� �'� �$'(���'7���.��������
��� ? . 4� �9��� ����������� $��.�9$% 7'7����'�.�� D ;F" �$���� ����7���*� � � E';���� ?�� ��� '� ����9'�)�9)8'�� ����. � E��
, 4� $� 5���)����.��$&(� �9)8�����.���*� ��� D � �� %�7'7� $�. 8'�� ����. 8�� �'� �$'(���'7���.��������
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � �� � � � ����� � � ���� �-� � �
� G!$I"I689 �)�#5�G��C�C�!�8$I� 7K�)�!� � ��68��?Customer103: Customer103: Customer103:(time=t0) (time=t1) (time=tn)...
...
Sex: M
Age: 53
Income: $50k
Own House: Yes
MS Products: Word
Computer: 386 PC
Purchase Excel?: ?
...
Sex: M
Age: 53
Income: $50k
Own House: Yes
MS Products: Word
...
Sex: M
Age: 53
Income: $50k
Own House: Yes
Purchase Excel?: ?
MS Products: Word
Computer: Pentium Computer: Pentium
Purchase Excel?: Yes
� G!$I"I689 �)�#���)"I�)� "I��68� ?Customer103: Customer103:
Age: 53 Age: 53 Age: 53Sex: M Sex: M Sex: M
Customer103:(time=t0) (time=t1) (time=tn)...
Income: $50k Income: $50k Income: $50k
Own House: Yes Own House: Yes Own House: Yes
Checking: $5k Checking: $20k Checking: $0
Savings: $15k Savings: $0Savings: $0
... ...Current−customer?: yes Current−customer?: NoCurrent−customer?: yes
� �36 � �B$3$ 6�5�"I��9 �� ���"I��6�� ?
(time=t0) (time=t1) (time=tn)...Product72: Product72: Product72:
...
Viscosity: 1.3
... ...
Viscosity: 1.3
Product underweight?: ?? Product underweight?:
Viscosity: 3.2
Yes
Fat content: 15%
Stage: mix
Mixing−speed: 60rpm
Density: 1.1
Stage: cook
Temperature: 325
Fat content: 12%
Density: 1.2
Stage: cool
Fan−speed: medium
Fat content: 12%
Spectral peak: 3200
Density: 2.8
Spectral peak: 2800 Spectral peak: 3100
Product underweight?: ??
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� �3687�(��)9 $ � 6 6 � ��� � G�(�" "I6 � ��68�8�x��9 7 � �2�!,
; ��� � " " � � 689 �)�3(4����G���,.���!�8��$ � 9 5�� 68� ��������&��B $
Sharp Left
SharpRight
4 Hidden Units
30 Output Units
30x32 Sensor Input Retina
Straight Ahead
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� ������� ��� � � � � � � � � � � ��� � � � � � ���
� "I"I5 ?��f&#&#& �U&#�%$I�)&#�%�3�� � 689
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � �� ��� � � � � � � � � ��� �
� 6 ,��f K?@"I��5 6�� "I��� �%� �)7K�:�3�
�� ���x$J"J* �8�:���)�x��"I��68� ��(���68�3�4"I��9 $)?@���)G��C��( ���:"�$��,.��� �%$I��68� "I�3�:��$��!���)�8����$3$I��68� � � �
<; 5�5�(����B, "I6 &'�)(�(+* � 6��39 �2"I��, ,��2"���7!�8$I�
� G!,�,>����� ���!,.G $J"I��
� 5�5K68��"IG����4" � 6�� "I689 6��3��6 & ? �:��68��9 68G!$'��9 5!�8�0"
��L���2�3� �8� ��6 $3$ � G�(�(�9 �+=��B,�* 9 ��,.�%� ,���"��
��L���2�3� �8� ��6 $3$#9 G�(�"A��5�(�� �4��"I�)���!��( ,���"���7 �8$J�B$���5�(�G!$"I��� &'�)7 ���!, ���)& $ � �)��,�$
��L���2�3� 7� �8� "I�!��� �0=�5K�)����9 �)� "���"I�468�
��L���2�3� ,.��� �%$I��68� $ �C��"A���)� "I� ��� 5�����,.� � "I��68� $
� G�9 G�(%�2"I�!�8� ��(���� �:(`68��� (��B���3�������
� ��68�8�x��9 9 ����� ( �����8G!�2�8��$ & �4"I� (����2�3���4����)9 7K��,�,.��,
� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � �-��� � � � � � � � � � � �A� � �
<; �3"I� /K� �%��(���� "I�)(�(��%�8�)� � �
�#�B ���$J� ��� 9 �)"I��6 ,�$
� 6�9 5�G�"��2"I��68�!�2(�� 689 5�(��0=���"- "I���:68�3
� 6���"I��68( "I���)6��3
� � � 68�39 ��"I��68� "I���)68��
� ���4(�6 $I685���
� $I ����6�(�68�8 ��� , ���)G��3687���68(�68��
� "���"I� $J"I� �)$ �����
M�� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � � � � � �!� ��� � � �� � � � � �
��������������� � � 9 5��36 � ����� &#��"A� �0=�5K�)�����)�!�0� ��" $J689 � "��8$�D
� 9 5���6���� 6��8�)�#"���$3D � �
�& �4"I� ����$J5K�B� " "I6 5K�)� � 68��9 ��� � � 9 �B�8$JG��3� � �
�7!�8$I��, 68� �0=�5K�:�3���:�!� � � �
� �U� � �>�L�B���3� "I6 5�( �B ��������D��)�x$
�� ? � (%�B �C������D��)�x$
� ?�� 6�� � ��9 �B$ &'68� ��� &'68��(%, "I68G����!��9 �)��"
� ? 685�5K68��"IG����4" "A6 5�(%�B ��� ���4�!$J" $J�)( �
M�M NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� ���!� ��� � � � � � � � � � � � � � �
�� ? � (%�B �C������D��)�x$
� ? � �)�x� �)� " 6 � � ��9 ��$'&'68� ��� &'68��(%, "I68G����!��9 �:��"
� �!��"#�0=�5K�)�����)� � �
� �!��"#�0=>�8�0"I(� $J��68G�(%, 7K� (�����������,K
� 6 & $I�!��(�( �4" 7K� ���)5�����$J�:��"I��,K
� �!��" $I5K��� �+/K� ��(���68�3�4"I��9 "I6 (�������� ��"�
M # NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � ��� � � ��� ��� � � � � � !�-� � � �
� ������� " 6�� �4�!,.������� "E
� ���8�����)�#68� ��68"�
; 5���687�(4�)9 ? �%$ "I�x����������� �0=�5K�)�����)�!� � ���)5�����$J�:��"���"A�!�8� 6��5K�)� � 68��9 ��� � � �86 ��(r
M � NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � � � � � � � � � � � � � �����'�
� ��������� � ��� ?�� ������� � �����
� ?�� ������� � �
� � �
M G NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � �.� � � � � ��� � ������� � � � � � � � � � � � ��������'� �
������ �%$ � /1�!��( 7K6 �2�C, $I"���"I� "I�!�2" �%$ &'68� �>"I���)�� ���� �
������ �%$ � /1�!��( 7K6 �2�C, $I"���"I� "I�!�2" �%$ (�6 $I"��1"A���)�� ���� �
������ �%$ � /1�!��( 7K6 �2�C, $I"���"I� "I�!�2" �%$ ,.�C�f&#� ��"I���)�� ���� �
������ �%$ � ��68" � /!�!��(�$I"���"I� ��� "I��� � ��9 � �."A���)�� ���� � � ��� ��� ��&#���:�3� ���>�%$<"A��� 7K��$J"</1�!��( 7K6 ���x,$J"��2"I� "I�!�2" �:��� 7K� ��������� �8��, $I"�����"I����� � ��689 � ��� ,5�(%�B �4��� 685�"A��9 ��(�(4 G�� "I��( "I��� �)�!, 6�� "I��� � ��9 ��
� ���%$ �8�!�8�B$ � 6��3����� " � ��(�G���$��!7�G�"#�%$ ��68"#685K�:�C��"A��68�!��(
M � NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � � � � �� � � � � � ����� � � � � �� � � �� � � � �����'�
<� 68(�(��B� "I�%68� 6 � �3G�(4��$x
����)G��x��( ���)"-&'68�CD
�5K68(� ��689 �%��( � G��!�0"I��68� 6 � 7K6 ���x, � �B��"IG�����$E � � �
M � NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � �� ��� � � � �����'� � � � ���!� ��� � � � ��������'�
����� � ��� �� ����� � ��� � � ��� ��� ����� ��� ����� ����� ��� ����� � ��� ��� ����� ����� ��� ��� ��� ����C?@��G�9 7K�)��6�� 7�(%�8��D 5������0��$<6�� 7K6 ���x, � � � ����C? ��G�9 7K�)� 6�� ����, 5����B� ��$ 68� � ��� ����C? ��G�9 7K�)� 6�� 7�(%�8�ED DH�4��� $ 68� � ��� ����C? ��G�9 7K�)�'6�� ����, DH����� $ 68� � � � ����C?@� G�9 7K�)�'6 � �3��, 5��4��� ��$ "I��������"I�:����, 7 7�(%�8��D� � �c�� �!&#���%�C� �:��� 7K� "��8D��)� 6�� 7�(%���ED � $<��� =�" "IG���� �
��� ��� �x?@��G�9 7K�)� 6 � 7�(%�8��D 5������ �B$<"I���3���2"I�)����, 7 ����,
M�� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � ��� � � � ��� � � � � � ��� � �-� �
� ����C? "I��� "I��G�� "������8�)" � G��!� "I�468� �� ���� ? "I��� (4����������, � G��!� "I�468� ��������� ����C?@"I��� "I�C�2��������� � ��(�G��
� ��� �3G�(�� � 68� �B$J"I�49 ��"I����� "I�x����������� � ��(4G���$)? � ������� ������ �� �� ������ ��� ���� ���� �
M � NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � � � � � � � � � � � ��� � � � �-�
��� � � ������� ���������� �� �����
� 6 ���)5K����"A��,.(� K?
� �)(����0" � "I�C�2��������� �0=>��9 5�(�� � ��"#�x���!,.6�9
� � 689 5�G�"I� � � ����� ����C?� ����� � ���� � ��� � ��� ���� �� ��� �
� � �!68� ���8�C� 7K6 �2�C, � �B��"IG���� � � ��G�5 ,���"A� &'�:���8��" � � ?
� � � � � � � ��� � �� � ����� ����� � $ $I689 � $I9 ��(�( � 68�!$I"���� "��!$��B � ��"A6 9 6 ,.�)�x��"I� "I����x��"I� 6�� (����2�3���4���
M�� NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � �>� � � � � � � � � �
DetermineTarget Function
Determine Representationof Learned Function
Determine Type of Training Experience
DetermineLearning Algorithm
Games against self
Games against experts Table of correct
moves
Linear functionof six features
Artificial neural network
Polynomial
Gradient descent
Board ➝ value
Board➝ move
Completed Design
...
...
Linear programming
...
...
# � NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������
� � � � ��� �>� � � � � ���� � � � � � ��1� � � �
� �!��" ��(���68�3�4"I��9 $ �)��� ��5�5��36 =���9 ��"I� � G�� � "I��68� $<&'�)(4(�p���!, &#���)� �A
� 6 & ,.6 ��$#��G�9 7K�)� 6�� "A�C���4������� � =>��9 5�(��B$ ��� �1G��)�!� ��8�)� G��x�8� �
� 6 & ,.6 ��$ � 689 5�(4�0=���" 6�� �� 5K6�"I����$I�%$�3�)5��3��$I�)� "���"I��6�� ��9 5!��� "#��"E
� 6 & ,.6 ��$#��68�%$I ,���"�� ��� �1G��)�!�0� �8�)� G��C�8�0 �
� �!��" ����� "I��� "I���)6��3�)"A�%�)��( (��49 ��"�$ 6�� (4�������!��7���(4��"� �
� 6 & �)��� 5�����68� DH��6 &#(���,>�8� 6�� (��B���3���)� ���)(45
� �!��" � (�G���$ �:��� &'� ���)" � ��689 7��468(�68�8� �)��( (����2�3���4���$J $I"I�)9 $E
� 6 & �)��� $I $J"A�)9 $#��(�"I�:� "I���)��� 6 &#��3�)5��3��$I�)� "���"I��6��!$x
#WM NPORQRSUTWVXO0YZNP[P\WORYA]_^`VJSZORa`ScbW^%^`dfe2g�hRi%jlknmEopmcg�qckrjsk�t`u�vxwWy2[zS{Q}|%ORNPN~ury2Q���VZ�����A[PNPN_u�M������