HyperAIHyperAI

Command Palette

Search for a command to run...

다층 퍼셉트론을 위한 양자 모델

Changpeng Shao

다층 퍼셉트론

노트북으로 이동

초록

퍼셉트론은 피드포워드 인공 신경망 중 가장 널리 사용되는 클래스입니다. 이 네트워크는 음성 인식, 이미지 인식, 기계 번역 소프트웨어 등 다양한 분야에서 폭넓게 활용되고 있습니다. 양자 머신러닝의 빠른 발전을 반영하기 위해 본 논문에서는 양자 컴퓨터에서 다층 퍼셉트론(Multilayer Perceptron)을 연구하기 위한 새로운 모델을 제안합니다. 여기에는 각 층의 출력 신호에 대한 양자 상태 준비 작업과 각 층의 가중치에 대한 학습 알고리즘의 양자 버전 구축을 포함한 다양한 작업이 포함됩니다. 우리는 이러한 양자 버전이 고전 알고리즘 대비 최소 2차 속도 향상(Quadratic Speedup) 또는 지수적 속도 향상(Exponential Speedup)을 달성할 수 있음을 입증합니다. 이는 양자 컴퓨터에서의 머신러닝과 그 응용 분야로서 다층 퍼셉트론을 연구하기 위한 효율적인 방법을 제시합니다. 마지막으로 영감을 얻어, 홉필드 네트워크(Hopfield network)를 위한 지수적 속도 향상 학습 알고리즘(Hebb 학습 규칙 기반)도 제안합니다.

One-sentence Summary

This paper proposes a quantum multilayer perceptron model that employs quantum state preparation for layer outputs and a quantum weight learning algorithm to achieve at least quadratic or exponential speedup over classical algorithms, thereby providing an efficient framework for quantum machine learning and inspiring a Hebbian-based exponential learning method for Hopfield networks.

Key Contributions

  • A quantum multilayer perceptron model encodes input and weight vectors as quantum states via qubit amplitudes, requiring only O(logn)O(\log n)O(logn) qubits while supporting arbitrary real-valued signals.
  • A parallel swap test technique integrates the nonlinear architecture of multilayer perceptrons into quantum circuits, enabling efficient implementations of online and batch weight learning algorithms.
  • The framework achieves at least quadratic or exponential speedup over classical methods for network inference and parameter updates, and extends to provide exponential acceleration for Hebbian learning in Hopfield networks.

Introduction

Multilayer perceptrons serve as foundational feed-forward neural networks for critical applications like image recognition and machine translation, making their quantum adaptation a highly valuable frontier in quantum machine learning. However, integrating these nonlinear architectures with quantum computing has proven difficult because prior models either violate quantum unitarity during weight updates or require linear qubit scaling that restricts inputs to binary values. To overcome these bottlenecks, the authors leverage an amplitude encoding scheme that represents input and weight vectors as quantum states using only logarithmic qubit resources. They introduce a parallel swap test technique to efficiently compute dot products and apply nonlinear activations, enabling quantum implementations of both forward propagation and weight training algorithms. This framework delivers at least quadratic or exponential speedups over classical methods and extends naturally to accelerate Hebbian learning in Hopfield networks.

Dataset

  • Dataset composition and sources: The authors construct a quantum dataset comprising input vectors, target outputs, and neural network weight parameters encoded as normalized quantum states. These states are generated algorithmically via unitary operators rather than drawn from external repositories.
  • Key details for each subset: The data is organized in batches of size ddd, loaded into a uniform superposition state 1dt=0d1t\frac{1}{\sqrt{d}}\sum_{t=0}^{d-1}|t\rangled1t=0d1t. Each state is prepared within O(Tin)O(T_{\text{in}})O(Tin) time complexity. The framework does not apply traditional filtering or cropping rules, as the states are mathematically normalized and directly mapped to the model's input and parameter dimensions.
  • Data usage in the model: The authors leverage these quantum states for batch training of output and hidden layer weights in a quantum multilayer perceptron. They utilize the parallel swap test to estimate inner products between input and weight states, enabling efficient gradient estimation and weight updates without classical data shuffling or fixed training splits.
  • Processing and state management: The pipeline relies on parallel state preparation, controlled rotations, and quantum phase estimation to encode inner product values into ancilla registers. After computation, inverse operations are applied to uncompute intermediate states and restore clean registers. All processing is optimized to maintain quantum coherence and achieve estimation precision ϵ\epsilonϵ within O(Tin/ϵ)O(T_{\text{in}}/\epsilon)O(Tin/ϵ) runtime.

Method

The quantum model for a multilayer perceptron is constructed by extending the principles of quantum state preparation and quantum parallelism to simulate the structure and learning dynamics of classical neural networks. The framework leverages quantum algorithms for efficient computation of inner products and nonlinear functions, enabling the simulation of both the forward pass and learning phase of a multilayer perceptron. The overall architecture consists of three primary components: quantum state preparation for input and weight vectors, quantum simulation of the network's forward propagation to compute outputs, and quantum implementation of the online learning algorithm to update weights.

The process begins with the preparation of quantum states representing the network's parameters and inputs. The input vector x\mathbf{x}x and weight vectors wi\mathbf{w}_iwi are encoded into quantum states x|x\ranglex and wi|w_i\ranglewi using efficient quantum algorithms. These algorithms, based on the linear combinations of unitaries (LCU) technique, allow for the preparation of a quantum state proportional to the given vector in time O(κ(x)logm)O(\kappa(\mathbf{x}) \log m)O(κ(x)logm), where κ(x)\kappa(\mathbf{x})κ(x) is the condition number of the vector. This step is fundamental to accessing the classical data in a quantum form.

The forward pass of the multilayer perceptron is simulated by computing the outputs of each layer. For the hidden layer, the authors employ a parallelized approach to generate the quantum state of the output vector y\mathbf{y}y. This is achieved by first preparing a superposition over the hidden units and then applying a control operation to create a state that contains the normalized input vector x|x\ranglex and each weight vector wi|w_i\ranglewi in parallel. A parallel swap test is then applied to compute the inner product xwi\mathbf{x} \cdot \mathbf{w}_ixwi for all iii simultaneously. This inner product is used to compute the sigmoid function φ(xwi)\varphi(\mathbf{x} \cdot \mathbf{w}_i)φ(xwi), which is then encoded into a quantum state using a controlled rotation. The result is a quantum state proportional to the output vector y\mathbf{y}y. This method achieves an exponential speedup over classical methods, with a complexity of O((logmn)/ϵ)O((\log m n)/\epsilon)O((logmn)/ϵ).

The output layer is simulated in a similar fashion. The quantum state of the hidden layer output Y|Y\rangleY is used as input. The process involves preparing a superposition over the output units and applying a control operation to combine Y|Y\rangleY with each output layer weight vector vi|v_i\ranglevi. A parallel swap test is used to compute the inner product yvi\mathbf{y} \cdot \mathbf{v}_iyvi, which is then used to compute the sigmoid function and encode the result into a quantum state. This yields the quantum state of the final output vector z\mathbf{z}z, with a complexity of O((logmnp)n/ϵ2)O((\log m n p)\sqrt{n}/\epsilon^2)O((logmnp)n/ϵ2).

The learning algorithm is implemented as an online learning process, where the weights are updated based on a single training sample at each iteration. The update rule for the output layer weights vj\mathbf{v}_jvj involves a term proportional to (rjtzjt)zjt(1zjt)yt(\mathbf{r}_j^t - \mathbf{z}_j^t)\mathbf{z}_j^t(1-\mathbf{z}_j^t)\mathbf{y}^t(rjtzjt)zjt(1zjt)yt. This is simulated by preparing a quantum state that combines the current weight vector ψjold|\psi_j^{\text{old}}\rangleψjold with the quantum state of the hidden layer output Yt|Y^t\rangleYt. A control operation is used to create a state that contains the updated weight vector vjnew\mathbf{v}_j^{\text{new}}vjnew in a superposition. A Hadamard transformation is applied to extract the new quantum state vjnew|v_j^{\text{new}}\ranglevjnew. This process avoids direct measurement, which would increase the complexity, and allows the algorithm to maintain a low computational cost. The complexity of this online learning algorithm is O(N3/2(logmn)n/ϵ2)O(N^{3/2}(\log m n)\sqrt{n}/\epsilon^2)O(N3/2(logmn)n/ϵ2), which provides a quadratic speedup at nnn and an exponential speedup at mmm compared to the classical algorithm.


AI로 AI 구축

아이디어에서 출시까지 — 무료 AI 코코딩, 즉시 사용 가능한 환경, 최적의 GPU 가격으로 AI 개발을 가속화하세요.

AI 협업 코딩
바로 사용 가능한 GPU
최적의 가격

HyperAI Newsletters

최신 정보 구독하기
한국 시간 매주 월요일 오전 9시 에 이번 주의 최신 업데이트를 메일로 발송합니다
이메일 서비스 제공: MailChimp