Market intelligence (MI) is gathering and analyzing information relevant to a company's market - trends, competitor and customer (existing, lost and targeted) monitoring.[1] It is a subtype of competitive intelligence (CI), which is data and information gathered by companies that provide continuous insight into market trends such as competitors' and customers' values and preferences.[1]

MI along with the marketing capabilities of an organization provides a guideline into the allocation and implementation of resources and processes.[2] It is used for the purpose of continuously supplying strategic marketing planning for organizations to gauge marketing positions in order for companies to gain competitive advantage and best meet objectives.[3][1]

Organizations can develop MI frameworks and models that are suited to financial capabilities and desired market sectors but are mainly based on the four-step process of collection, validation, processing and communication of MI.[4] The gathering of MI data is sorted into many different categories, including, but not limited to, qualitative, quantitative, formal, informal, published, and unpublished.[5] MI data is gathered both internally and externally.[5]

Benefits that MI can bring are that it provides customer, competitor and market insights allowing organizations to gain a competitive advantage in their marketing strategies.[1] Issues that MI can bring is through acquiring data and information through illegal or unethical ways, it can lead to financial loss and government regulatory failures.[6]

Background and Development

edit

MI and its broader term, marketing intelligence, was first introduced in “Marketing Intelligence for Top Management” by Kelley,[7] to provide information that was analyzed, reliable and consistent for an organization to better create policies and make business decisions.[7]

Following Kelley, in “How to Develop a Marketing Intelligence System”, R. Pinkerton shows the proactiveness of organizations as marketing intelligence systems is applied whilst the technological revolution arises.[8] Contributions to MI include professional organizations such as “Global Intelligence Alliance” and “the Society of Competitive Intelligence Professionals” (SCIP).[9] These organizations have contributed both empirical and theoretical research in an attempt to further define and understand MI.[9]

As research into MI comes from scholars and non-scholars of different backgrounds it has resulted in a fragmented state of research. This has led to MI being used interchangeably with other market terms such as competitive intelligence, business intelligence and strategic intelligence.[9] MI to this current date continues to change to meet organizational requirements.[7]

Framework

edit

The implementation of MI varies depending on how organizations perceive it.[3] MI is defined as being composed of three main activities, these activities are Information Acquisition, the gathering of marketing information that is required for current and future customer needs, Information Analysis which is the intelligence gained from the information collected and Information Activation, which is using the intelligence to implement and develop marketing plans.[5]

Frameworks can be flexible, however the basis that organizations use to model the MI surrounds a four-step process, which are, collection, validation, processing and communication.[4] Data mining techniques are used throughout the processes to aid in the gathering and analyzing of data and information retrieved.[citation needed] MI is a continuous process that organizations need to keep track of to improve their strategic and tactical marketing planning.[10] These processes target the three activities that MI is defined by.[5] The model can be adjusted and adapted when required and can be implemented all at once or by sections.[3]

Collection

edit

Collection is the first step in the MI model, it involves the gathering of data and information of a particular market sector.[3] Such data and information can be gathered from external sources, such as other organisations and their market strategies, research institutes and business reports.[3]

Internal factors can include looking into current strategy processes and personal customer trends.[3] It is estimated that 70% to 80% of intelligence resides within organizations employees or, internal MI network, as they are the team who gains information's when interacting with suppliers, customers and other industry contacts.[11] To involve employees into an intelligence program to gain data and information the following considerations can be noted: developing a rewards program to promote participation, providing MI goals, requirements and a timeframe for information to be given in and creating a proper communication method to promote the intelligence program with employees such as using an e-mail system.[12][13]

A challenge that arises in the collection of data and information is the identification of relevant information, this is a result of organizations not clearly defining a market sector.[citation needed]

Validation

edit
 
Shows the duplication of data which reduces data quality [14]

Validation is the second step in the MI model, this which can be referred to as data cleansing.[3][15] The maintenance of good data quality is important as data and information is being retrieved from many different sources.[15] Data and information obtained from sources can be dirty, meaning that it is incomplete, wrong, inappropriate, duplicated.[3] This step will allow data and information to be adjusted and understandable to the organization, furthermore it allows for consistency and compliance to be present.[3] If data quality is not maintained correctly it can lead to organizational losses with revenue and governmental regulation failures.[6]

Method of Validation

edit

Data cleansing is a complex process that involves several stages in order to get good data quality for MI strategy use.[15] Stages include defining the organization's level of data quality, detecting error from the data collected and then repairing the errors.[16] The five stages of data cleansing are data analysis to identify errors, eliminating the errors, checking to ensure elimination of error are done appropriately, refreshing the data in the data warehouse and finally replacing the dirty data with clean data.[17]

Processing

edit

Processing is the third step in the MI model.[4] It involves the use of translating the clean data using organizational rules, modelling, logic and analysis to produce readable information, reports and spreadsheets that allows the organization to gain specified knowledge.[3] The interpretation of data into readable information is difficult as it is complex, it requires proper technology and heavy commitment from a top organizational level to match data and information gained and align it to a marketing strategy.[18]

Communication

edit

Communication is the last step in the MI model. It involves the sharing, delivering and transmission of information gained from the processing step to figures in the organization who will apply it accordingly to the market strategy.[19] As MI is a continuously changing, the communication of the MI strategy requires managers whom have expertise in the given market industry in order to determine the ongoing validity of the MI strategy and its implementation.[20] In order to make the communication of the MI strategy as successful as possible, this process must be performed by every level of an organization, also known as the intelligence organization.[8]

Intelligence Organization

edit

Intelligence organization refers to the “people and information resources who make the market intelligence process happen”.[1] The five elements of an intelligence organization are, MI leadership who manages and leads the MI process, a MI team, a portfolio of external information sources that is set up by the MI team, internal MI network made up of MI users and the MI user's personal information source network.[1] An intelligence organization element is made up of external and internal factors that allows for a continuous MI process.[1][8]

Gathering market intelligence data

edit
 
[14] Use of search engines in gathering MI

The gathering of MI data is different dependent on an organization's financial capabilities. Sources of data and information is separated into qualitative, quantitative, formal, informal, published and unpublished. With such sources being retrieved both internally and externally from the organization.[8] It involves using search engines and corporate web sites to see competitor's strategies, identifying business trends through reputable publications and existing customer clientele.[21] Organizations use different systems to gather MI, one system is that is used is Open-source Intelligence system.[22]

Internal intelligence gathering

edit

Sources of internal intelligence gathering include but are not limited to, gathering data from customers, manufacturers, through research and development (R&D), employees, also known as salesforce, physical evidence, sales quotes, sales records, trade shows and new hires.[23] These data sources were ranked by organizations on a scale measuring five for being very important to one being not important. It was founded that customers and manufacturers and R&D are the most important to organizations with one hundred percent of organizations ranking these data sources with the number four or higher[24],. It shows that in the process of collection and gathering MI data and information, these data sources brought the most value to organizations.

External intelligence gathering

edit

Sources of external intelligence gathering is included but is not limited to, gathering data from client meetings, dealers/distributors, customers, business associates, market research projects, suppliers, online services, periodicals and government publications.[23] These data sources were compared on the same scale as internal intelligence gathering sources, with results showing that intelligence gathered through client meetings being the most important to organizations, with one hundred percent of organizations ranking this data source with the number four or higher.[24]

Information systems intelligence gathering

edit

Marketing information systems allow for organizations to continuously acquire, generate, and maintain external and internal information.[25] They are systems that make use of artificial intelligence (AI) technology to aid in the planning of strategic and tactical marketing strategy of MI but also share marketing expertise.[25]

Open-source Intelligence (OSINT)

edit

Open-source intelligence is a predominant form of MI gathering that organizations employ. OSINT is defined as the scanning, finding, gathering, exploitation, validation, analysis, and sharing with intelligence-seeking clients of publicly available print and digital/electronic data from unclassified, non-secret, and grey literature.[26] It is frequently used as its system is user friendly, its inexpensive and that it processes an abundant amount of raw materials that can be further processed.[22]

Impacts of market intelligence

edit

Using MI can bring to organizations both benefits and issues depending on how MI is acquired, maintained, and implemented. Benefits that MI can bring includes but is not limited to gaining competitive advantage in their marketing strategies.[1] Issues that MI can bring can include but is not limited to, financial losses and government regulatory failures.[3]

Issues

edit

There are issues that arises in the process of acquiring MI data and information and the implementation of an organizations marketing strategy. Issues such as the acquiring intelligence unethically and illegally can lead to failures with government regulations, also, if dirty data is not properly cleansed and problems aren't mitigated or resolved can lead to a range of negative impacts that can result in financial and reputational losses to the organization.[3][6]

Legality and ethics

edit
 
[27] British Airways aeroplane

An issue that can arise is the unethical and illegal collection of data and information. Organizations can collect data for MI illegally or unethically to try to gain competitive advantages; this is known as industrial espionage.[28] An example of illegal MI collection practice is when British Airways breached the Data Protect Act 1984 through accessing Virgin's confidential flight details.[29][3]

A standard of conduct was developed by the non-for-profit organization Society of Competitive Intelligence Professionals, creating a code of ethics that can be adhered to by organizations when collecting market intelligence, to prevent the illegal and unethical collection of data and information.[3]

Dirty Data

edit

Dirty data that is collected needs to be cleansed to maintain good data quality. Challenges that arise in data cleansing is that there is a large volume of data being received leading to organizations being faced with many risks of failure to detect dirty data being processed through.[30] If data quality is not managed properly, it can result in financial losses, inefficient implementation of MI strategies and failure to comply with government regulations.[31] A reason for financial loss is due operational costs, as there is an increase in resources and time spent to identify and fix the dirty data.[6]

Benefits

edit

MI processes have been used in many organization's strategic market planning, however, there are still difficulties in what the hard and soft benefits in using a MI process for an organization.[1] The benefits of a successful MI process can be sectioned into three categories, better and faster decisions, time and cost savings and organizational learning and new ideas, however, overall, it can improve profitability and the competitiveness of an organization.[1] The competitiveness of an organization increases as with more MI gathered it'll provide a way for organizations to innovate through improving current methods and increasing the ability to find and create new products.[32]

References

edit
  1. ^ a b c d e f g h i j Hedin, Hans; Hirvensalo, Irmeli; Vaarnas, Markko, eds. (2012-01-02). The Handbook of Market Intelligence. doi:10.1002/9781119208082. ISBN 9781119208082.
  2. ^ Carson, Grace; O'Connor, Christina; Simmons, Geoff (2020-01-01). "The crucial role of market intelligence in the development of small business marketing capabilities". Journal of Small Business and Enterprise Development. 27 (5): 797–816. doi:10.1108/JSBED-12-2019-0394. ISSN 1462-6004. S2CID 225735797.
  3. ^ a b c d e f g h i j k l m n Jamil, George Leal (2013-01-01). "Approaching Market Intelligence Concept through a Case Analysis: Continuous Knowledge for Marketing Strategic Management and its Complementarity to Competitive Intelligence". Procedia Technology. 9: 463–472. doi:10.1016/j.protcy.2013.12.051. ISSN 2212-0173.
  4. ^ a b c Jamil, George Leal (2013). "Approaching Market Intelligence Concept through a Case Analysis: Continuous Knowledge for Marketing Strategic Management and its Complementarity to Competitive Intelligence". Procedia Technology. 9: 466. doi:10.1016/j.protcy.2013.12.051. ISSN 2212-0173.
  5. ^ a b c d Kumar Vishnoi, Sushant; Bagga, Teena (2020). "Marketing Intelligence: Antecedents and Consequences". SSRN Electronic Journal: 2. doi:10.2139/ssrn.3563107. ISSN 1556-5068. S2CID 229598952.
  6. ^ a b c d Redman, Thomas C. (1998). "The impact of poor data quality on the typical enterprise". Communications of the ACM. 41 (2): 81. doi:10.1145/269012.269025. ISSN 0001-0782. S2CID 17205136.
  7. ^ a b c Kelley, William T. (1965-10-01). "Marketing Intelligence for Top Management". Journal of Marketing. 29 (4): 19–24. doi:10.1177/002224296502900405. ISSN 0022-2429. S2CID 168050731.
  8. ^ a b c d Kumar Vishnoi, Sushant; Bagga, Teena (2020-03-28). "Marketing Intelligence: Antecedents and Consequences". Rochester, NY. doi:10.2139/ssrn.3563107. S2CID 229598952. SSRN 3563107. {{cite journal}}: Cite journal requires |journal= (help)
  9. ^ a b c Egan, Michelle P. (2001-06-14), "Conclusion: Governance and Market-Building", Constructing a European Market, Oxford University Press, pp. 260–272, doi:10.1093/0199244057.003.0011, ISBN 978-0-19-924405-8, retrieved 2021-05-31
  10. ^ Fuller, Connie J. (6 January 2023). "What is Tactical Marketing?". Marketing. Retrieved 6 January 2023.
  11. ^ Tsu Wee Tan, Thomas; Ahmed, Zafar U. (1999). "Managing market intelligence: an Asian marketing research perspective". Marketing Intelligence & Planning. 17 (6): 39. doi:10.1108/02634509910293124. ISSN 0263-4503.
  12. ^ Tsu Wee Tan, Thomas; Ahmed, Zafar U. (1999). "Managing market intelligence: an Asian marketing research perspective". Marketing Intelligence & Planning. 17 (6): 302. doi:10.1108/02634509910293124. ISSN 0263-4503.
  13. ^ Gordon, Ian, June 19- (1989). Beat the competition : how to use competitive intelligence to develop winning business strategies. Oxford, UK: B. Blackwell. ISBN 0-631-15991-6. OCLC 19125425.{{cite book}}: CS1 maint: multiple names: authors list (link) CS1 maint: numeric names: authors list (link)
  14. ^ a b "Creative Commons — Attribution-ShareAlike 4.0 International — CC BY-SA 4.0". creativecommons.org. Retrieved 2021-05-31.
  15. ^ a b c Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 731–738. doi:10.1016/j.procs.2019.11.177. ISSN 1877-0509.
  16. ^ Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 732. doi:10.1016/j.procs.2019.11.177. ISSN 1877-0509.
  17. ^ Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 734. doi:10.1016/j.procs.2019.11.177. ISSN 1877-0509.
  18. ^ Fleisher, Craig (1990). "The competitive analysis of non-market intelligence". Competitive Intelligence Review. 1 (2): 11–13. doi:10.1002/cir.3880010206. ISSN 1058-0247.
  19. ^ Heang, Rasmey (2017). BOOK REVIEW: THE USE OF MARKET INTELLIGENCEIN COMPETITIVE ANALYSIS. Digitala Vetenskapliga Arkivet. p. 8.
  20. ^ Heang, Rasmey (2017). BOOK REVIEW: THE USE OF MARKET INTELLIGENCEIN COMPETITIVE ANALYSIS. Digitala Vetenskapliga Arkivet. p. 48.
  21. ^ "SCIP Europe established". Competitive Intelligence Review. 2 (1): 51–52. 1991. doi:10.1002/cir.3880020129. ISSN 1058-0247.
  22. ^ a b Sharma, Arun (2020-07-17). "The organization of customer support services". European Journal of Marketing. 54 (7): 1813–1814. doi:10.1108/ejm-07-2020-974. ISSN 0309-0566.
  23. ^ a b Lackman, Conway; Saban, Kenneth; Lanasa, John (2000-02-01). "The contribution of market intelligence to tactical and strategic business decisions". Marketing Intelligence & Planning. 18 (1): 8. doi:10.1108/02634500010308530. ISSN 0263-4503.
  24. ^ a b Lackman, Conway; Saban, Kenneth; Lanasa, John (2000-02-01). "The contribution of market intelligence to tactical and strategic business decisions". Marketing Intelligence & Planning. 18 (1): 7. doi:10.1108/02634500010308530. ISSN 0263-4503.
  25. ^ a b Kumar Vishnoi, Sushant; Bagga, Teena (2020). "Marketing Intelligence: Antecedents and Consequences". SSRN Electronic Journal: 4. doi:10.2139/ssrn.3563107. ISSN 1556-5068. S2CID 229598952.
  26. ^ Fleisher, Craig S. (2008-07-25). Calof, Jonathan L. (ed.). "Using open source data in developing competitive and marketing intelligence". European Journal of Marketing. 42 (7/8): 853. doi:10.1108/03090560810877196. ISSN 0309-0566.
  27. ^ "Creative Commons — Attribution-ShareAlike 3.0 Unported — CC BY-SA 3.0". creativecommons.org. Retrieved 2021-05-31.
  28. ^ Button, Mark (2020-03-01). "Editorial: economic and industrial espionage". Security Journal. 33 (1): 2. doi:10.1057/s41284-019-00195-5. ISSN 1743-4645.
  29. ^ "Battle of the Airlines: Computer hacking of flight details 'was". The Independent. 2011-10-22. Retrieved 2021-05-19.
  30. ^ Amaravadi, Chandra S.; Samaddar, Subhashish; Dutta, Siddhartha (1995). "Intelligent marketing information systems:: computerized intelligence for marketing decision making". Marketing Intelligence & Planning. 13 (2): 734. doi:10.1108/02634509510083464. ISSN 0263-4503.
  31. ^ Redman, Thomas C. (1998). "The impact of poor data quality on the typical enterprise". Communications of the ACM. 41 (2): 80. doi:10.1145/269012.269025. ISSN 0001-0782. S2CID 17205136.
  32. ^ "[EBOOK] Market Intelligence: Stand out with Data Monitoring". resources.rockcontent.com. Retrieved 2021-06-02.