(Solved Homework): The multi-layer network below is being trained using backpropagation. The current input/output pair is x_…

The multi-layer network below is being trained using backpropagation. The current input/output pair is x_p(k) = (1.0, 1.0, 1.0)^t and d_p(k) = (0.0, 0.5, 1.0)^t. The weights and node outputs are given in the table below (note that, for ease of making the table, I’m using the letter “w” to represent all weights since I’ve numbered the nodes sequentially). Assume the sigmoid activation function (logistic function) for each node with a = 1. Using a learning rate of 0.1 and a momentum term of 0.4, compute delta_6 (k), delta_4(k) and w_64(k + 1) (assume that the previous weight change was 0.08). First, write out the backpropagation formula

Expert Answer

Don't use plagiarized sources. Get Your Custom Essay on

Get an essay WRITTEN FOR YOU, Plagiarism free, and by an EXPERT!

Order Essay

t is the target
units[l] is the number of units in layer l
n[l][i] is unit i in layer l
n[l][i].output is the output
n[l][i].delta is the delta
n[l][i].weight[j] is weight j
ek is the learning constant

adapt() {
int i,j,k,l;

  for(l=layers-1;l>=0;l--) 
    for(i=0;i<units[l];i++) 
      if(l==layers-1)
        n[l][i].delta=
          ek*n[l][i].output*
          (1.0-n[l][i].output)*
          (t[i]-n[l][i].output);
      else {
        n[l][i].delta=0.0;
        for(k=0;k<units[l];k++)
          n[l][i].delta+=
            n[l+1][k].delta*
            n[l+1][k].weight[i];
        n[l][i].delta=n[l][i].delta*
          ek*n[l][i].output*
          (1.0-n[l][i].output);
       }  
    
  
  for(l=layers-1;l>=1;l--) 
    for(i=0;i<units[l];i++) 
      for(j=0;j<weights;j++)
        n[l][i].weight[j]+=
           n[l-1][j].output*
           n[l][i].delta;
      
    
   for(i=0;i<units[0];i++)
     for(j=0;j<weights;j++)
       n[0][i].weight[j]+=
         input[j]*n[0][i].delta;
}

When this algorithm is applied to the XOR we get the following output.

iteration no 0, inputs 0 1, target 1, output 0.477995 
iteration no 20, inputs 0 0, target 1, output 0.447816 
iteration no 40, inputs 1 0, target 0, output 0.450292 
iteration no 60, inputs 0 0, target 1, output 0.549096 
iteration no 80, inputs 1 0, target 0, output 0.460706 
iteration no 100, inputs 0 0, target 1, output 0.507636 
iteration no 120, inputs 0 1, target 1, output 0.571619 
iteration no 140, inputs 1 0, target 0, output 0.451493 
iteration no 160, inputs 0 1, target 1, output 0.570574 
iteration no 180, inputs 0 0, target 1, output 0.575979 
iteration no 200, inputs 0 1, target 1, output 0.744079 
iteration no 220, inputs 1 0, target 0, output 0.233541 
iteration no 240, inputs 0 1, target 1, output 0.755600 
iteration no 260, inputs 1 1, target 0, output 0.185273 
iteration no 280, inputs 0 1, target 1, output 0.788309 
iteration no 300, inputs 1 1, target 0, output 0.167068 
iteration no 320, inputs 1 0, target 0, output 0.123461 
iteration no 340, inputs 1 1, target 0, output 0.132892 
iteration no 360, inputs 1 1, target 0, output 0.133583 
iteration no 380, inputs 1 1, target 0, output 0.116641 
iteration no 400, inputs 1 0, target 0, output 0.088269 
iteration no 420, inputs 0 0, target 1, output 0.861810 
iteration no 440, inputs 1 1, target 0, output 0.102406 
iteration no 460, inputs 1 0, target 0, output 0.080179 
iteration no 480, inputs 1 0, target 0, output 0.075584 
iteration no 500, inputs 0 0, target 1, output 0.884442 
iteration no 520, inputs 0 0, target 1, output 0.892789 
iteration no 540, inputs 0 1, target 1, output 0.923969 
iteration no 560, inputs 1 0, target 0, output 0.064146 
iteration no 580, inputs 1 1, target 0, output 0.071938 
iteration no 600, inputs 1 1, target 0, output 0.075764 
iteration no 620, inputs 1 1, target 0, output 0.074536 
iteration no 640, inputs 1 1, target 0, output 0.069014 
iteration no 660, inputs 1 1, target 0, output 0.066534 
iteration no 680, inputs 0 0, target 1, output 0.918422 
iteration no 700, inputs 0 0, target 1, output 0.924860 
iteration no 720, inputs 1 1, target 0, output 0.065864 
iteration no 740, inputs 1 0, target 0, output 0.052634 
iteration no 760, inputs 0 0, target 1, output 0.927081 
iteration no 780, inputs 1 0, target 0, output 0.050964 
iteration no 800, inputs 0 1, target 1, output 0.948869 
iteration no 820, inputs 1 0, target 0, output 0.049082 
iteration no 840, inputs 1 0, target 0, output 0.048074 
iteration no 860, inputs 1 1, target 0, output 0.057916 
iteration no 880, inputs 1 1, target 0, output 0.056088 
iteration no 900, inputs 0 1, target 1, output 0.954659 
iteration no 920, inputs 1 1, target 0, output 0.057337 
iteration no 940, inputs 0 0, target 1, output 0.944243 
iteration no 960, inputs 1 0, target 0, output 0.045653 
iteration no 980, inputs 0 0, target 1, output 0.946199

Top Quality and Well-Researched Papers

We always make sure that writers follow all your instructions precisely. You can choose your academic level: high school, college/university or professional, and we will assign a writer who has a respective degree.

Professional and Experienced Academic Writers

We have a team of professional writers with experience in academic and business writing. Many are native speakers and able to perform any task for which you need help.

Free Unlimited Revisions

If you think we missed something, send your order for a free revision. You have 10 days to submit the order for review after you have received the final document. You can do this yourself after logging into your personal account or by contacting our support.

Prompt Delivery and 100% Money-Back-Guarantee

All papers are always delivered on time. In case we need more time to master your paper, we may contact you regarding the deadline extension. In case you cannot provide us with more time, a 100% refund is guaranteed.

Original & Confidential

We use several writing tools checks to ensure that all documents you receive are free from plagiarism. Our editors carefully review all quotations in the text. We also promise maximum confidentiality in all of our services.

24/7 Customer Support

Our support agents are available 24 hours a day 7 days a week and committed to providing you with the best customer experience. Get in touch whenever you need any assistance.

Try it now!

Calculate the price of your order

Type of paper needed:

Pages:

Academic level:

Total price:

$0.00

How it works?

Follow these simple steps to get your paper done

Place your order

Fill in the order form and provide all details of your assignment.

Proceed with the payment

Choose the payment system that suits you most.

Receive the final file

Once your paper is ready, we will email it to you.

Our Services

No need to work on your paper at night. Sleep tight, we will cover your back. We offer all kinds of writing services.

Essays

Essay Writing Service

No matter what kind of academic paper you need and how urgent you need it, you are welcome to choose your academic level and the type of your paper at an affordable price. We take care of all your paper needs and give a 24/7 customer care support system.

Admissions

Admission Essays & Business Writing Help

An admission essay is an essay or other written statement by a candidate, often a potential student enrolling in a college, university, or graduate school. You can be rest assurred that through our service we will write the best admission essay for you.

Reviews

Editing Support

Our academic writers and editors make the necessary changes to your paper so that it is polished. We also format your document by correctly quoting the sources and creating reference lists in the formats APA, Harvard, MLA, Chicago / Turabian.

Reviews

Revision Support

If you think your paper could be improved, you can request a review. In this case, your paper will be checked by the writer or assigned to an editor. You can use this option as many times as you see fit. This is free because we want you to be completely satisfied with the service offered.