How Arweave works and why it exists
Arweave, Arweave's working principle and significance of existence Golden Finance, this article briefly introduces Arweave's working principle and value.
JinseFinanceAuthor: Jomosis Reviewer: 0xmiddle Typesetting: Lawrence
After the AO conference, the Arweave ecosystem once again became the focus of attention. PermaDAO invited experts in the Arweave field to work Discuss AO's philosophy, design and user experience, focusing on the new opportunities AO brings to developers and the entire blockchain industry, as well as AO's new narrative for the blockchain industry.
In the rapid evolution of the digital world, Arweave has quietly emerged in the blockchain industry with its unique decentralized storage concept since its birth in 2018. Takes its place on the track. Five years have passed, and Arweave’s name has been spread among technology enthusiasts, but its profound technical characteristics have also made many people feel familiar and distant. Now, with the emergence of AO, this ecosystem has once again become the focus of attention, triggering a series of curiosity and questions.
In order to answer these doubts, PermaDAO launched a unique X Space and invited a number of heavyweight guests to discuss whether AO will become the "killer" of Ethereum.
We are fortunate to invite one of the founders of AO and the proposer of the SCP paradigm - Xiong Wei @outprog_ar, the evangelist of AO and the co-founder of ChainFeeds - Pan Zhixiong @nake13, the founder of ArweaveOasis - @ GerryWon, and SevenX Head of Research — @Hill79025920, who has been following the Arweave track for a long time. They will lead us back through the history of Arweave’s technological development since its inception and enhance our in-depth understanding of this decentralized storage pioneer. Let’s unveil the mystery of AO and explore how it can further promote the development of a new blockchain narrative.
p>
Zhixiong Pan:“AO is a data protocol for standardized data processing and information exchange.”
The original design intentions of Arweave and Ethereum are different. Ethereum is for computing services, while Arweave goes straight to storage. But founder Sam has been exploring a different idea to implement a world computer from the beginning, and AO came into being. AO is not a computer or an independent network. AO is a data protocol based on Arweave, which sets standards for data processing and information exchange. As long as the logs responsible for data calculations are stored on Arweave, a world computer can be run on Arweave, and tasks on it can be operated in parallel. For example, the SCP paradigm becomes AO after being abstracted and standardized.
Gerry Wang:“AO has completed the computing puzzle for Arweave.”
AO’s hierarchical structure can Benchmark against the structure of the SCP paradigm. Arweave is the information sharing layer of AO. Programs running on AO can share data on Arweave to achieve the goal of creating a decentralized world computer. Projects on traditional blockchains are crowded on single-threaded blockchains and queued to run. AO is based on Arweave, and builds a computing layer on top that can run processes in parallel, solving the scalability problem and opening up space for imagination. AO transforms Arweave from a storage-only blockchain to a blockchain with parallel computing capabilities.
p>
Hill: “AO implements the function of enhanced inscription.”
From the valuation From a perspective, the value of GPU capture is huge, and the development in the direction of computing is good for Arweave. From the perspective of users and investors, Arweave is equivalent to an enhanced version of inscription. In the Bitcoin network, due to storage limitations, users can only perform some relatively simple operations such as minting, deploying, and transferring assets, and most calculations are performed on the off-chain indexer. Indexers have no incentive to do evil because users can verify the calculation process and results by replacing the indexer or running the indexer themselves. On Arweave, since its storage capacity far exceeds that of Bitcoin, developers can build a more complex and powerful computing layer on top of it. AO is based on this idea, which allows all computing instructions and intermediate state results to be stored on Arweave, thereby achieving computing capabilities similar to Bitcoin Inscription, but more powerful and flexible.
p>
outprog:“The AO protocol enables effective information exchange and collaboration between different applications, providing an open platform with unlimited possibilities.”
At its core, AO is a messaging protocol that allows communication between different applications running on Arweave. Each application can send request information to AO's network, for example, asking for the balance of an account. The application that receives the request will use its own consensus operation and send the result back to the requester through the AO network. In this way, different applications can use the AO network to perform combined operations and realize the exchange of cross-chain information.
AO's communication protocol is not limited to blockchain applications. It can also allow traditional Web2 applications to participate in this decentralized network by accessing the AO protocol interface. . This means that both Web2 and Web3 applications can use the AO computer for trusted message authentication and collaboration.
He also emphasized that AO Computer’s vision is to break the boundaries between Web2 and Web3, allowing developers to use Web2 methods to develop decentralized applications, or to allow Web2 applications to directly integrate with Web3 applications Carry out information bridging and interoperability. The design of this communication protocol makes the AO computer an open platform, supports interoperability between various applications, and provides unlimited possibilities for developers.
p>
Zhixiong Pan
The focus of architectural design: AO solves storage problems first, and EVM considers computing problems first
< ol class=" list-paddingleft-2">AO computer: focuses on the permanent storage of data, providing a huge, immutable storage space, similar to the paper tape of the Turing machine, for storage and perform calculations.
Ethereum EVM: focuses on computing power and provides an environment for executing smart contracts. Its original design is to achieve Turing completeness and allow the execution of complex computing tasks.
Computing model: AO can run computing tasks independently on different nodes, EVM requires all nodes to run the same computing tasks
< ol class=" list-paddingleft-2">AO computer: Based on distributed storage and parallel computing, it allows computing tasks to be run independently on different nodes and communicate and collaborate through the AO network.
Ethereum EVM: Using a centralized computing model, all nodes need to perform the same computing process to verify transactions and smart contracts, which results in computing redundancy.
Consensus mechanism: AO uses data to maintain consensus, and EVM uses competition or equity to reach consensus
AO Computer: Using the Hash Chain consensus mechanism, the number of data sets stored by miners becomes the largest contributor to mining performance, focusing on data accessibility and storage of continuity.
Ethereum EVM: operates under the PoW (Proof of Work) or PoS (Proof of Stake) consensus mechanism, focusing on reaching network consensus through competition or equity.
Calculation logic: AO can define its own calculation logic, while EVM can only follow predefined operation logic
AO Computer: The execution of smart contracts is closely related to data storage. The computing logic can be customized according to application requirements and has higher flexibility at the storage level.
Ethereum EVM: The execution of smart contracts follows predefined opcodes, which are executed in the same way on all nodes to ensure the consistency of the network state.
span>
outprog
1. The architecture of Ethereum EVM:The original design of Ethereum’s EVM is based on Bitcoin scripts An extension designed to achieve Turing-complete computing capabilities. Ethereum makes it easier for EVM to implement state changes and calculations by replacing the UTXO model with a state model.
2. Computational redundancy problem: Ethereum’s computational redundancy is very high because each transaction needs to be repeatedly calculated on thousands of nodes in the network , resulting in a lot of waste of resources. This is one of the reasons why Ethereum has difficulty breaking through its performance limitations, because it is essentially a single-threaded machine.
3. The architecture of AO computer: The architecture of AO computer is completely different from that of Ethereum EVM. The AO computer is based on Arweave, a distributed, immutable storage system. In an AO computer, computing resources are decentralized, and there can be multiple independent nodes performing operations. These nodes can independently process data sets and perform calculations.
4. Parallel computing and collaboration: AO computers allow different nodes to operate independently and collaborate as needed. This parallel computing model enables the AO computer to handle more complex tasks and improves overall network performance.
5. Concurrency model of AO computer: The architecture of AO computer supports concurrent processing, which is in contrast to the single-threaded computing model of Ethereum EVM. The concurrency model of the AO computer is similar to the actor model in the Erlang language, which implements concurrency between different processes through message passing.
6. Practicality of AO computer: The design of AO computer is pragmatic. It is not just a theoretical idea, but has been realized and can be used in practice. The release and application of AO Computer demonstrates its practicality and complements existing blockchain technology.
Gerry Wang
1. Continuous pursuit of long-term goals:The Arweave team is focused on achieving its long-term goals, even if they may not immediately appeal to the public Notice. They improve the consensus mechanism through constant updates and iterations to ensure the stability and efficiency of the network.
2. Iterative improvements to the consensus mechanism: Arweave has iterated on at least four versions of its consensus mechanism, each aimed at reducing computing power competition and increasing data replication. and storage efficiency. This iterative process demonstrates the Arweave team’s attention to technical details and continuous optimization of network performance.
Editor's note: Please refer to "One article to understand Arweave's Consensus mechanism iteration process》Learn more.
3. Pragmatic development attitude: The Arweave team tends to adopt mature and proven solutions, such as actor models, during the development process. They don't pursue short-term hype, but focus on building an optimal system, which reflects their emphasis on practicality and stability.
4. Low-key and focused work style: The Arweave team may not appear in the public eye frequently, but they are quietly carrying out continuous development work behind the scenes. Their low-key working style and serious attitude towards iteration enable the Arweave ecosystem to develop steadily.
5. Integration of existing solutions: When Arweave builds its system, it will integrate existing solutions, such as actor models, to ensure efficient operation of the system. This integration strategy helps Arweave achieve its goals quickly while maintaining system stability and reliability.
p>
outprog
Access challenges: 1. Users may encounter network problems when trying to access the AO computer, which may It is caused by improper VPN settings or other network connection issues. 2. Since AO is currently in the testing phase, there may be some bugs and system problems, which may affect users' access to the test network.
Access method: 1. Users can learn how to access the AO computer through online tutorials and demonstrations. For example, Sam and Tom provided detailed instructions at the launch showing how to use NPM and the Arweave gateway to download and run the original program. 2. Users need to establish the corresponding Connector or Process, which is a key component for communicating with the AO network.
Teaching demonstration address: https://twitter.com/aoTheComputer/status/1763702970040856833
Usage experience: 1.
strong>For developers, following tutorials and demonstrations, they can gradually experience the entire process of AO computers under good network conditions. 2. Even for non-developers, by watching the demonstration, they can clearly understand the working principle and operation process of the AO computer.Ease of use: The AO computer seems to be designed to provide an experience that is easy to understand and operate, even in the beta phase, encouraging users to experiment and explore.
p>
outprog
1. Token separation:AO tokens and AR tokens are functionally separated. The AO token focuses on solving the communication problem between applications, while the AR token focuses on Arweave’s storage functionality. This separation is similar to the division of labor in the real world, with each token having its specific roles and responsibilities.
2. Design principles of AO token: The design of AO token will be based on observations in practice and testing the actual operation of the network. Sam Williams (founder of Arweave) will weigh and design the AO token based on these realities to ensure it can effectively serve the needs of the network.
3. Focus of AR Token: The goal of AR Token is to support Arweave’s permanent storage capabilities. Sam is not interested in other features such as staking, DeFi, etc. His main goal is to ensure that Arweave can achieve permanent storage of data.
4. Practicality of tokens: The design of AO tokens will follow optimal principles to support the communication needs of global distributed and decentralized computers. This design philosophy emphasizes the utility and efficiency of the token within the network.
5. Pragmatic attitude towards tokens: From a pragmatic point of view, the division of labor in tokens is necessary. Trying to solve all problems (such as compute and storage) with a single token can lead to high costs, while by separating token functions, their respective goals can be achieved more efficiently.
Gerry Wang
1. Token positioning:AR token is regarded as a more professional and rigorous asset, and its design and use will follow strict standards. AO tokens are relatively more flexible, and their specific definitions and mechanisms are not yet clear and require further observation and formulation.
2. Miner incentive issues: a. The Arweave network has a limited number of miner nodes, and miners have a clear need for profits. Without sufficient incentives, miners may turn to other more profitable mining activities. b. Arweave has established a treasury mechanism called endowment, which automatically deposits part of the mining rewards into the treasury and gradually releases it to miners over time to ensure long-term storage of data.
3. Challenges in the incentive mechanism: a. The current incentive mechanism may be unattractive to miners pursuing immediate profits, which may affect the stability and long-term development of the network. b. AO tokens may be able to explore new incentive methods to increase the enthusiasm of miners, thereby strengthening the foundation of the entire network.
4. Future Outlook:a. If an effective incentive mechanism can be designed to allow miners to benefit from AO tokens, then this will be a very excellent system design . b. Currently, these problems and potential solutions are still in the process of observation and resolution and require further exploration and practice.
Based on the past style of the Arweave team, guests speculated that airdrops may be issued to early Arweave ecosystem users, or that AR tokens need to be destroyed in exchange for AO. The specific details are still waiting to be announced by the Arweave official team.
p>
outprog
The way to access AO is to access the message we want to broadcast on the AO network according to the message specifications of the AO protocol. Whether it is a Web2 or Web3 program, you only need to access the information in the native program or native nodes through the AO message interface.
AO can provide project support:
Compatibility:AO supports various All forms of threads, whether based on WASM or EVM, can be connected to AO through certain technical means.
Content co-creation projects: AO also supports content co-creation projects. You can publish atomic NFT on AO, upload data and combine it with UDL to Build NFT on AO.
Data composability: NFT on AR and AO can achieve data composability, allowing an article or content to be shared and shared on multiple platforms Display while maintaining the consistency and original properties of the data source. When content is updated, the AO network can broadcast these update statuses to all relevant platforms to ensure synchronization of content and dissemination of the latest status.
Value feedback and ownership:Content creators can sell their works as NFTs and transfer ownership information through the AO network to realize the value of the content Give back.
Q1: Can AOS be understood as a thread of AO?
A: AOS is currently a terminal tool. Developers use AOS to download, run and run threads. So AOS is a tool set on the AO protocol.
Q2: Is each application an AO, or is the application on AOS? Or will developers deploy applications on the AO thread?
A: 1. The relationship between applications and AO: Theoretically, applications can exist as independent AO instances, or they can run on the protocol layer of AO. The key is whether the application follows the AO's protocol specifications and is able to send and receive data according to these specifications.
2. The versatility of the AO protocol:The AO protocol is a communication protocol that allows applications written in different languages (such as Golang or JavaScript) to communicate under the premise of complying with the protocol specifications. communicate with each other. This communication is achieved by sending data to the AO network. 3) The role of AOS: AOS can be regarded as an environment that supports application development and deployment. Applications can be developed on AOS and interact with the AO network through AOS.
3. The role of AOS:AOS can be viewed as an environment that supports application development and deployment. Applications can be developed on AOS and interact with the AO network through AOS.
4. Application deployment: Developers can choose to deploy applications on AO's threads, which means that the application will interact directly with the communication protocol of the AO network. This deployment method allows applications to take advantage of the parallel computing and data transfer capabilities of the AO network.
5. Analogy to microservice architecture: The AO network can be analogized to a microservice architecture, in which each application (or service) is an independent unit, and they pass through AO protocol to communicate. This architecture is similar to the Kafka message queue and is used to implement message delivery between services.
In summary, Web2 or Web3 applications can become threads on AO. After using the AO protocol standards, verifiable communication can be carried out throughout the AO network or computing environment.
Q3: What is the difference between AO and ICP?
A: ICP is equivalent to being developed under a standardized container, and each container has some memory limitations. AO and ICP actually use the actor model model. The difference is that ICP provides a cloud service in a container model similar to Docker, while AO is more flexible. You don't need to use AOS, as long as you follow AO's Protocol standards, whether Web2 or Web3 applications, can access AO.
outprog
Polkadot is a relay chain + parachain model. Each process of AO is equivalent to Polkadot's relay chain. If AO needs to pledge AO tokens in the future to run a process, this will be similar to Polkadot's auction slot.
Hill
The similarity between AO and Polkadot:
1. Security guarantee: Polkadot’s relay chain provides security guarantees for all parallel chains, while in the AO computer, Arweave (AR) provides security guarantees for each computing unit (process). Both are responsible for storing the global state and ensuring the security of the network.
2. Composability: Both AO computers and Polkadot support composability, which means that different computing units or parallel chains can cooperate with each other to implement complex functions.
The difference between AO and Polkadot:
1. Architectural differences: Polkadot has a centralized relay chain , and the AO computer is based on Arweave's decentralized storage, and the calculation results of each computing unit are stored on Arweave.
2. Deployment freedom: Polkadot used to have card slot restrictions. Although this restriction has been lifted now, AO computers have no card slot restrictions in principle, allowing users to deploy their own machine to run the computing unit.
p>
Hill
1. The value of permanent data: AO is based on the permanent storage feature of Arweave and emphasizes the long-term value of data. In the Web2 era, data was usually stored in large company databases, while in the Web3 era, data is stored on the blockchain, but the cost is usually higher. AO provides a low-cost permanent storage solution that enables high-value data to continue to generate value.
2. The combination of AI and blockchain:In the field of AI, data and computing power are two key scarce resources that generate value. AO provides AI with access to permanently stored high-value data while maintaining the lowest storage costs in the industry. This combination provides new possibilities for the development of AI applications on the blockchain.
3. Potential of decentralized AI applications: AO’s scalability creates conditions for the development of decentralized AI applications. As AI products become more dependent on specific data sets, the products themselves may become increasingly valuable as the data accumulates.
4. Native access to Arweave’s computing layer: AO is the only solution that can natively access Arweave’s computing layer, which provides developers with a unique platform to Build and run AI applications based on persistent data.
5. Industry impact of AO:The release of AO attracted industry attention and was regarded as a potentially game-changing technology. It not only provides a new perspective on the application of AI in blockchain, but also brings a new narrative direction to the development of the entire blockchain industry.
Zhixiong Pan
1. Improvement of user experience:AO’s framework allows developers to build applications that are more in line with Web2 user habits, which means that users You can enjoy the convenience of decentralized applications without perceiving the complexity of blockchain technology.
2. Implementation of full-stack Web3 applications: AO enables developers to create full-stack Web3 applications, including static and dynamic web pages, as well as applications that require computing. This provides developers with greater flexibility, allowing them to design richer and more complex applications.
3. Integration of AI data: The release of AO may bring new solutions to the processing and storage of AI data, which may change the magnitude of AI data processing method, providing new possibilities for the application of AI on the blockchain.
4. Challenges to the existing economic model: The release of AO may bring challenges to Arweave’s economic model because it may change users’ views on storage and computing resources. need. This may require Arweave to adapt accordingly to new market and technological developments.
5. Integration of technology and user habits:AO’s goal is to build an application that can fit most users’ habits without requiring users to understand the technology behind it. This narrative emphasizes the importance of blockchain technology’s ease of use and user-friendliness.
Gerry Wang
1. Breakthrough in scalability:AO combined with Arweave provides a scalability solution that is different from traditional blockchains plan. It no longer relies on users to compete for limited bandwidth resources, but enhances the scalability of the network through parallel computing modules, thus avoiding the bottleneck problem in traditional blockchain networks.
2. A new model of decentralized computing: AO’s design philosophy is to create a super-parallel computer that allows any number of processes to run in parallel at the same time. This model not only supports large-scale calculations, but also ensures the verifiability of calculations, which is something that previous decentralized computing systems did not have.
3. Feasibility of practical applications: AO’s white paper mentioned applications such as BitTorrent as examples, demonstrating the widespread use and feasibility of the bandwidth sharing model. The success of this model demonstrates the potential and usefulness of the decentralized computing approach adopted by AO for practical applications.
4. Shift in industry narrative:The release of AO is not just a technical innovation, it also changes the narrative of the blockchain industry. AO provides a new perspective to solve the scalability problem of blockchain through decentralization and parallel computing, which provides new directions and possibilities for the development of the industry.
5. Prospects: The release of AO is seen as promising because it provides a feasible and pragmatic solution to improve the scalability of the blockchain sex. This solution is not only feasible in theory, but also shows its strong potential in practical applications.
outprog
1. Transition from storage to computing:The release of AO marks that Arweave is no longer just a storage platform, but has added Calculate ability. This provides a new option for other blockchain projects, allowing developers to develop applications more conveniently without having to worry about underlying transactions and transaction processing.
2. Improve user experience: The launch of AO allows developers to develop applications in a way that is more in line with Web2 user habits, providing a better user experience. Users can enjoy the convenience of decentralized applications without being aware of the technical complexity behind them.
3. Openness and inclusiveness: AO’s computing power provides the possibility of integration for various blockchain projects, whether it is Web3, Web2 or other blockchains , can all be integrated on the AO network, demonstrating its high degree of openness and inclusiveness.
4. Decentralized identity system: The release of AO allows users to manage their identities more flexibly, such as using a mobile phone as a hardware wallet, combining email and mobile phone binding, Enable decentralized identity verification.
5. A platform for the past, present and future: AO’s computing power allows Arweave to not only store past historical data, but also carry current data, and may even Activity across the entire Internet is recorded on Arweave, making it a comprehensive, historic platform
6. Reshaping the Blockchain Narrative:The release of AO resets Arweave’s narrative transforms from a single storage chain to a comprehensive computing and storage platform. This shift is of great significance to the development of the entire blockchain ecosystem, providing more possibilities for developers and users.
Question 1: How does DAPP access AO? Does the front-end page of the application have to interact with the back-end API interface written as process?
Answer:
1. DAPP accesses AO: DAPP can connect to the AO computer through messages ( messages) interface to access the AO network. This means that DAPP can utilize the communication capabilities of the AO network to interact with other applications or services.
For DAPPs that need to perform specific calculations or issue tokens, AO provides native process support. Developers can use these processes to implement DAPP's computing needs or token issuance functions.
2. Front-end and back-end API interaction: The front-end page does not have to be written as a process to interact with the back-end API interface. Developers can choose to directly connect to AO's message interface, or use existing back-end services (such as Alipay) as a process of AO and transfer information to other platforms through the AO network.
If the back-end service of DAPP is already a process, the front-end page can interact with it through the AO network to send and receive data. This interactive method allows DAPP to achieve cross-chain communication and data sharing in the AO network.
The final suggestion for developers is to use AO as a messaging system when developing AO applications. If you don’t understand the AO system, you can learn the Erlang language. The terminology in the AO architecture is basically the same as that in Erlang.
Question 2: Does AO have any plans to develop SDK in the future?
Answer: Maybe Arweave officials will not do it themselves, and the project needs to be developed by itself. everVision plans to develop a series of tools in the Golang language that can interface with AR and AO. I believe there will also be SDKs for various other languages in the ecosystem.
Question 3: How to develop smart contracts on AO?
Answer: Your own smart contracts on AO need to be developed using Lua. However, threads on AO are compatible with smart contracts in other languages, whether Solidity, Move, Rust or Warp.
I hope everyone will pay attention to the technological development of AO, rather than just focusing on the short-term financial gains in the secondary market . While financial markets may bring quick gains, the real value comes from long-term ecological development and support from the developer community. The long-term development of AO depends on the healthy development of the ecosystem and the activity of the developer community. Excellent projects and innovative applications will also support the continued growth of AO
Arweave, Arweave's working principle and significance of existence Golden Finance, this article briefly introduces Arweave's working principle and value.
JinseFinanceIn this article, we discuss in detail how storage donation works and then study its characteristics and risk profile by simulating its execution using Markov chains.
JinseFinanceThis article will explore the redundancy mechanisms of Arweave and IPFS, and which option is safer for your data.
JinseFinance100 billion WhatsApp messages are sent every day. Most blockchains are not designed for storage. If you want to store 100 billion WhatsApp messages on Ethereum or any blockchain, it will be extremely expensive.
JinseFinanceThis article explores how Arweave and IPFS store, maintain, and access files, and how this affects the reliability and durability of digital assets.
JinseFinanceArweave is a decentralized data storage solution that provides permanent and immutable data storage services through its Blockweave technology and native cryptocurrency AR token.
JinseFinanceThe Succinct Proof of Access (#SPoA) game can be used by any participant to prove that they actually store some data at a specific location in a dataset. This pattern can also be used to create a second game, which we call a concise proof of replication.
JinseFinanceWhy is Arweave not a replacement for Filecoin, but a more significant innovation worthy of attention?
JinseFinanceA Bitcoin user spent $64,000 on fees to inscribe 9 MB of binary data on the blockchain, sparking widespread curiosity and theories.
Xu Lin